Testing Tester/Manager

Testing Visual Studio!31/5/2012Testing Tester/Manager

1Testing Tester/Manager31/5/2012 SafeCape Software Solutions

6/1/2012 1:11 PM 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2SafeCape Software Solutions : , end to endALM-Sharepoint-Project Server:Microsoft Silver PartnerDedicated Visual Studio reseller

Insurance.Office

Accounting.Office

Reinsurance.Broker

Framework.Health

Rules Toolset (Personal Genetics)

Dedicated Visual Studio reseller developers Visual Studio ( ) licensing

AgendaUse caseTesting the UI (Coded UI Tests)Testing web apps / services (Web Tests)Load TestingHow do I get it ( & )6Use CaseUse case - OverviewCustomer: (Ins. Co.)

: : Web ServiceDesktop application (proof of concept)Web site (B2C)

8Use case - OverviewISV: SafeCape

:Powered by Rules.Toolset, available:On premiseSaaS Azure :desktop application (WPF)web application (ASP.NET)

Rules.Toolset design toolsModel EditorAuthoring tool - Desktop applicationQuality Control Client

Report Template EditorReport template authoring tool, Word 2007/2010 Add On

Rules.Toolset ServicesModeler (Execution engine) Report Generator (produces Open XML docs)Quality Control

Available as:In-process (dlls) ( Quality Control)Web servicesOn premise (IIS/SQL)Windows Azure (Web Role) / SQL Azure

SafeCape Challenges (ISV) ;

web services :On premise typical configurationAzure : instance size / number of instances

T Azure ; business model ; ;

Ins. Co. Challenges (Customer) SafeCape ;

custom SafeCape (UAT);Functional requirementsNon-functional requirements (, )

, Rules.Toolset, ;Visual Studio Testing ToolsVisual Studio Testing Tools ;

:. Microsoft

: web : php, Java, python, node.js UI: Windows OS (. CUIT Platform Support)Testing the UITesting the UIRegression testsData driven testsAutomate complex scenarios

Functional requirementsNon-functional requirementsResponse times (Load test)

Create UI Test using:Coded UI Test Builder (recorder)Existing Action Recording (TFS/MTM)Manual testsExploratory tests (VS11)17Code UI Test Platform Support

DemoCoded UI Tests19Testing Web AppsTesting web appsWeb Performance Tests : HTTP basedRecord->Edit->Playback Load testingWeb Test Recorder (IE Add-on) :Sessionid, cookies, hidden form fields-viewstateA correlation :Extract from response -> Bind to requestWeb Test Playback (VS)Page preview / request-response contentFind/extract tools

21Authoring web testsDeclarative editingLooping / conditional branchingExtraction rulesValidation rulesVerificationGoal validation rules (e.g. response time < 2sec)Data driven testsTransactionsAdvanced features coded web testExtensibility custom pluginsWeb test recorder pluginsWeb test result viewer pluginsDemoWeb Tests24Load TestingLoad Testing TerminologyResponse time / , ?Throughput / server?Resource utilization (CPU, memory, network) o?Load/Stress Test Feature Set (1) Load patternsGoal-basedStepConstant browsers Duration-based and iteration based

27Load/Stress Test Feature Set (2) Performance CountersIntegration data collectorsASP.net profilerIntellitraceFull test results on errors ExcelVirtual user activity chart

28Load Test Architecture

database server

Microsoft Test Manager 2010test controller

Load agentVisual StudioWeb serverLoad patternsGoal based Constant loadStep goal based constant load throughput response time DemoLoad Testing31

Usefull resourcesContent Index for Unit Testhttp://blogs.msdn.com/b/mathew_aniyan/archive/2012/05/17/content-index-for-unit-test.aspxContent Index for Coded UI Testhttp://blogs.msdn.com/b/mathew_aniyan/archive/2010/02/11/content-index-for-coded-ui-test.aspxContent Index for Web Tests and Load Testshttp://blogs.msdn.com/b/edglas/archive/2007/12/17/content-index-for-web-tests-and-load-tests.aspxUsing Visual Studio Load Tests in Windows Azure Roleshttp://msdn.microsoft.com/en-us/library/windowsazure/hh674491.aspx