“Cliff Notes” Recap and Q&A-- Mastering Agile Development and Testing with HP Software executives

Did you miss Mastering Agile Development and Testing in the Brave New World of Mobile and Cloud applications webcast with HP executives Ajei Gopal and Matt Morgan on March 14th?   No worries as we have multiple ways to recap the timely and useful insights and interaction that occurred during the Web event and following Tweet Chat.   We are providing three ways to catch up “cliff notes style”. 

 

cliff-notes.jpg

 

Listen:  you can listen on your own to the live webcast and short Q&A that followed on the replay here.

 

Look:  Access the PDF here of the visuals that were presented.

 

Learn:  more in the Q&A document at the end of this blog that answers the variety of questions asked during the event and in the Tweet Chat that followed.

 

In Cliff Notes summary fashion:   Here are the key takeaways.

 

1.  The time is now for rethinking the way you and your teams build, test and deliver applications.  

 

The business of building, deploying, and managing of technology assets is undergoing the most fundamental of shifts.    We are in the middle of the largest enterprise mobile application rollout in history.   In addition to mobility, the use of SaaS and public and private cloud resources are becoming common place…and on top of this, global competition is driving a level of urgency resulting in a dramatic acceleration of the development lifecycle.

 

To bring the point home, check out the following key fact:  According to Nielsen, time spent in mobile apps continues to dwarf mobile Web engagement. As of August 2012, minutes spent per month in mobile apps were 4.6 times that of the mobile Web:   The agile delivery of mobile solutions will be a critical success factor for all business success if not now, very soon.

 

mobiledata.png 

 

 

2.  But the biggest change in the new style of IT isn’t about technology at all, it is about the user. 

 

Now that the computer has moved to the pocket and internet connections have moved to the airwaves, apps are expected to know and understand the user, rather than the other way around. In the webcast, we characterized this new style of IT as a world where the system must revolve around the user, rather than making the user revolve around the system.

 

If you take nothing else away from the webcast, you can at least go back to your business stakeholders and say: “You were right all along, it IS all about you.”

 

3.  And success in this brave new world requires balancing two attributes:  velocity and quality.  

 

The Webcast continues to explore the challenges to velocity and quality and the key success factors of visibility, collaboration, virtualization and automation you can employ to succeed in this brave new world.    But just don’t take it from me, spend a short 30 minutes and listen to the replay.

 

Once you’ve done so, tell us what did you think?  Are you ready for the new style of IT? 

 

Ask more questions and we can continue to provide thoughts and answers here on this blog, in upcoming TweetChats and at HP Discover, this June 11-13th, in sunny Las Vegas…

 

I’m looking forward to continuing the conversation.

 

__________

 

 

Webcast Questions and Answers:

 

1)     Can you provide an example of how Development and Test teams work together (i.e. via new feature walkthroughs, TDD, Development demos, etc.) on an Agile project? 

 

Developer and tester collaboration is a key aspect to attaining the velocity with quality that today’s organizations requires delivering the New Style of IT.  An example would be when a product owner submits a high priority user story and the ScrumMaster initiates the sprint, both a developer and a tester will see the tasks and begin working on the sprint.  If the team is using a tool like HP Agile Manager, they can see the minute the developer checks in source code and the tester can use the user story to create a test case and use HP Sprinter to initiate exploratory testing.  Defects found while exploratory testing can immediately be alerted to the developer to discuss in the daily Scrum.  

 

2)      Is the HP Solution for Functional Testing for Mobile Applications ready?

 

HP’s mobile application testing solutions encompass all aspects of testing from functional to performance to security.   For functional testing, HP offers UFT Mobile which is a complete solution from HP for on both real and emulated devices.  Our Mobile performance testing solution is based on HP LoadRunner.  Our mobile security solution is HP Fortify.

 

3)      We are hearing more about DevOps in Agile teams, what about testing?  Can you highlight why companies should not leave testing to operations or even end consumers after product delivery?

 

Ironically, the more our industry focuses on speed, the more we need to manage and maintain a laser focus on quality.  Testing is becoming a fully-integration part of an Agile delivery team.  We as an industry must focus on real-time collaboration between those building code and validating and testing.  Testing is moving further up in the delivery process earlier and earlier.   With the combination of visibility attained through Agile and ALM management solutions that bring in task status and change across requirements or user stories, development and test, and exploratory testing and test automation which can make the process of testing  faster, Agile teams have the ability to weave testing throughout their iterations or sprints without QA becoming a bottleneck.  If anything, testing becomes less conspicuous and more a symbiotic part of the agile delivery cycle.

 

4)      How can QC be integrated with other tools to provide end-to-end traceability of the entire lifecycle?  

 

Both HP Quality Center and HP ALM offer open integration architecture for integrating other tools customers may choose to use in their delivery lifecycle.   Our integration architecture is based on standard APIs such as REST and enables metadata synchronization between HP software (QC and ALM) and other development and ALM tools such as build systems, Source Code Management systems, lab provisioning services and other defect or developer task management systems.  We currently support over 70 ALM and development tool integrations with HP QC and HP ALM.

 

5)      Do you have real device (smart phone, Tablets) testing solution, may be a cloud based?  

 

HP’s mobile testing solutions offer the option to test on real-devices or emulators.   Real device testing is key to get a realistic line on application behavior.  As an example, HP’s UFT Mobile offers a service where users have access to a fully supported and up-to-date mobile device cloud that delivers the ability to test on real devices without the overhead of having to maintain their own device lab. 

 

6)       How does secure code development play a role in this approach to development?    How does Agile ensure the secure code is being practiced?

 

Whether or not an application meets the needs of a business with expected quality is much more than just functionality.  Performance and security both play a major role in application delivery success.  And as Agile practices are speeding up cycle times to deliver incremental functionality in weeks or even days, the role of the development teams to ensure secure code that performs and works without exposing the organization to security risk becomes even more vital.  

 

HP is both advising and seeing in best-in-class organizations, a cultural shift and adoption of practices and tools to ensure secure code development.  HP’s Fortify software security solutions help dev teams adopt secure development best practices by scanning code for a wide array of continually updated code vulnerabilities and making real-time recommendations of code adjustments to minimize risk.  Teams that build the policy to do secure code analysis in their Agile sprint development and continuous integration cycles are seeing much fewer security vulnerabilities leak into staging or production operations where it is much more expensive to fix and carries greater risk to the business.

 

7)       Can you please share this slide deck? 

 

The presentation is available here.

 

8)       This is a Keyword-driven tool? or only record and playback?

 

This question is pertaining to our discussion of HP Unified Functional Testing and how it helps automate testing for mobile scenarios and Agile teams looking to do continuous integration.   HP Unified Functional Testing offers choice of script-based or keyword-driven testing, which simplifies test creation and execution. With a powerful test flow viewer, testers can build test cases by capturing flows directly from the application screens and applying robust record/replay capturing technology.

 

9)       Are there any plans to offer agile manager on premise?

 

HP Agile Manager, recently released in February of 2013, is available flexibly as a SaaS solution.  We are finding a majority of teams are looking for the ease of automated provisioning and fast access that SaaS provides.  However, we do understand a number of organization s have corporate or organizational policies that preclude use of SaaS.  We are assessing the possibility of an on-premise solution.

 

10)   Is HP UFT for Mobile just UFT with Perfecto Mobile add-in?

 

UFT for Mobile is HP’s automated testing solution for all varieties of mobile devices.  It leverages the well-known user environment for creating automated tests with keywords, record-replay and scripting and now extends to not only Web and API applications and services but mobile applications.  It can operate in real device or emulated mode and when tests are being executed on real-devices, it can take advantage of a mobile device cloud service.  With this cloud service, teams no longer have to procure and manage their own “mobile device test lab” but can count on HP delivering an up-to-date managed service of readily available mobile devices for testing.  We have partnered with Perfecto Mobile for the underlying service; however, the complete solution is fully supported by HP.

 

11)   What tool is this? Proficiency in which programming language is required to use this tool for automation?

 

This question also refers to HP Unified Functional testing and UFT mobile.  UFT does not require programming however, when creating functional test automations; often the tester will want to use scripting to create specific test behavior.    HP UFT can automate testing for a wide array of applications and underlying protocols so it is not specific to a type of application.  HP UFT power users have full access to the underlying test and object properties through an integrated scripting and debugging environment that is synchronized with the keyword view and includes times savers such as auto-completion of code, customized and built-in code snippets, and tools for labor-intensive validation activities such as file-content checkpoints (result .vs. source), bitmap checkpoints (validity of graphics on a tester’s screen) and array checkpoints (presence or absence of value).  The scripting language supported by UFT is Visual Basic.

 

12)   Unified functional test, this is like QTP ?

 

Unified functional testing is the evolution of HP’s automated functional testing solutions.  HP Quick Test Professional, used by 1000’s of customers for Web/GUI testing and HP Service Test, used by testers and developers to automate API testing, have come together in a single, integrated solution with a common user experience in HP Unified Functional Testing. With HP UFT, QTP users will easily recognize the tooling capabilities they know but enhanced to be able to do full end-to-end automated functional testing.  No longer do you need to support two different tools to automate testing of composite applications.

 

13)   Does Agile Manager integrate with Perforce?

 

Yes, through HP’s Application lifecycle integration framework, HP Agile manager can integrate metadata and information about source code check-ins and changes from Perforce.   Supported SCM integrations include: Subversion, GIT, Microsoft TFS, Perforce, Accurev and many others.

 

14)   Are there any known issues with integrating agile manager with an on premise version of quality center?

 

There are no known issues with integrating HP Agile manager with HP ALM or HP Quality Center on premise.  It is important to test network connectivity and any firewall configurations but this is not related to the Agile Manager or HP QC software itself.

 

15)   Is Agile Manager just the Advanced Agile Accelerator?  Why is this only available on SAAS and not available for users who already have internal QC instances?

 

The Agile Accelerator is a solution designed for HP Quality Center and HP ALM users who would like to organize their lifecycle and workflow processes to align with Agile Methodology, It is essentially a customized HP ALM and HP QC project template and workflow that embraces Agile terminology and structure but allows teams to continue to operate in QC and ALM as always.   It is not the same as HP Agile manager which is a purpose-built solution for enabling organization and management of Agile projects and teams.   As we mentioned in an earlier question, we are considering offering an on-premise solution for customers.  Today, however, we offer integration between HP QC and HP ALM and HP Agile Manager to keep activities and metadata in synch across projects and between testing and development tasks and progress on Agile teams.

 

16). Does HP Diagnostics fit into the mobile/cloud dev/testing environment, and if so, how?

 

Yes, Diagnostics is an important and valuable software tool for testing in mobile and cloud environments.  In particular, performance behavior can change dramatically when applications are moved to the cloud or re-architected to support mobile interaction.  Diagnostics greatly help developers and performance engineers in quickly visualizing and identifying the aspects of the application that may be causing performance degradations down to the application server, network layer, or subsystem level including areas like memory leakages, garbage collection and more. 

 

17)   Hi, in the delta case study how did they handle the following to reduce test time:   - Reusable data sets  - environment stability (ensures accurate prod scenario)  - Regression testing baseline  - mitigate increase in defects

 

To read the entire Delta case study for more detail, please click here.

 

18)   Are there any trial versions of HP products

 

Yes, a majority of HP software solutions have trial versions available for download or access on HP.com.  For example, if you would like a 30 day trial of HP Agile Manager, please access the trial version here.

 

19)   Has anybody used this methodology for SAP implementations?

 

We have a number of customers who use HP ALM, HP Quality Center and our unified functional testing and performance testing solutions for the challenges of upgrading, evolving and customizing packaged applications including SAP.   You can read more in many case studies on SAP and Quality Center, ALM and the like on our HP Software customer case study library page here.

 

20)   Could you please give more detail about functional testing of Mobile App.

 

We have a number of resources available on our mobile testing page on hp.com.  A good place to start is with the following white paper:  Change your IT mobile application challenges into opportunities. Five mobile application considerati...

 

21)   What impact does source control tool selection have on quality and velocity?

 

Source control or source code configuration management is a key developer software tool to keep track of developer source artifacts and the progression and impact of change.  It helps with developer velocity by managing source change and overall delivery velocity and quality when integrated into an ALM or Agile management platform so that the entire team can have visibility to source changes and know immediately if change brings a new risk or a new need for testing.

 

22)   In what ways can agile reduce the time it takes to build an automated solution for a QA org?

 

Test and quality automation and Agile are complementary goals.   And adoption of Agile Methodology raises the importance of employing automation to keep testing and continuous integration flowing through the sprints.   When new changes are being introduced weekly and even daily, the importance of being able to automate API, build verification and regression tests becomes critical.  So in essence, Agile is a primary driver for a QA team to build the ability to employ automation in their practices.

 

23)   Which integration do you have between UFT and Continuous integration?

 

There are a few ways to integrate HP UFT with solutions for Continuous integration.  For a seamless ALM solution that supports continuous integration, HP ALM has a capability for lab management automation that includes UFT integration.  Build systems and application builds can be configured to be provisioned on a build action – including provisioning of the build system (Jenkins, Hudson, etc.) and the build itself.  ALM uses HP Continuous Delivery Automation for the modeling and provisioning.   Once the build is provisioned, the UFT automated test can be kicked off to do the build verification testing.

In addition, for people using Jenkins or Hudson and wanting to get started with automated testing but not ready for a full ALM solution yet, HP has developed an open source plug-in with Jenkins and Hudson and HP UFT for Continuous integration use cases.

 

24)   How effective the software version of whiteboard sticky notes will be as compare to the real life white board in terms of time saving. 

 

Using a tool like HP Agile manager to keep track of your team’s activities in sprints is critical to reduce cycle time especially when teams are distribution.  Capturing tasks, time estimations, owners and progress digitally in a software solution is a much faster and mistake-proof way of keeping teams on track as opposed to manual processes such as white board editing and email updates.  

 

25)   I know Jenkins plugin works with HP QC 11.00. In case if don’t use Jenkins then does new HP ALM 11.5 can do similar job like Jenkins? How?

 

HP ALM is not a build management software solution but it can handle the modeling, scheduling and provisioning and de-provisioning of builds and build systems as part of a managed lifecycle employing continuous delivery.   HP ALM has a capability known as lab management automation to do this scheduling and provisioning work.  To learn more about HP ALM Lab Management automation, refer to the following HP ALM Lab Management data sheet

 

26)   How do you manage automatic test in different environment and language. We use UFT and Java code to test our products

 

HP UFT can support over 30 unique application types and environments so it is designed for highly heterogeneous application landscapes including Java, Microsoft, legacy and packaged applications.

 

27)   Which convergence of dashboard between functional tests and load test in ALM?

 

HP ALM brings together lifecycle progress, quality, testing and defect information into a centralized solution where out of the box and custom reports and dashboards can be easily scheduled, created and exported/exposed to users on portals, web sites and mobile devices. HP ALM is able to create quality dashboards that can contain real-time information on test status and defects across functional testing, performance testing and even security testing when the HP Fortify security testing solutions are used in combination with HP ALM. 

 

28)   Does HP Master Agile Development and Testing platform/tools work for Data warehouse applications?

 

HP testing and lifecycle management tools can be used with any type of application as long as the underlying language and protocols are supported and HP offers the industry’s largest amount of supported configurations across custom, legacy and packaged applications.  The type of application is not a mitigating concern to get the benefits of lifecycle management and automated testing.

 

29)   Could you support new configuration management like Mercurial?

 

Mercurial is not automatically supported out of the box but HP ALM ALI has an open API for integrations and Mecurial offers a number of open extensions for integration so it could be accomplished via services. 

 

30)   Are you giving recos who should use those products? Business Testers or Professional Testers?

 

HP testing solutions are designed for a wide array of testing needs and skill levels.  API testing and functional test automation are tasks typically done by more technical testing teams as performance testing is typically done by a performance engineering expert.   However, exploratory testing and using business process test frameworks such as HP BPT is often the domain of a business tester or someone with more business knowledge rather than programming skills.  To learn more about the skills of testing and HP’s holistic test maturity model, refer to our functional testing page here.

 

31)   How you manage Model Based testing (MBT) approach?  the reference are not test cases but the model

 

While not a pure form of model based testing, In HP’s ALM and Quality Center software, we offer a requirements definition and management capability which can be driven off of a business process model imported in BPMN or BPEL from a business process modeling tools such as Aris or Provision.   Then, these requirements can form the basis of business components that can be set up in HP’s Business Process testing test framework to help test teams create test sets from these re-usable testing components.     When the business process changes, the requirements can be changes and the BPT components changed as well.

 

How the tests are actually executed is via a set of test automation scripts or manual test cases that makes up the integrated components which are part of the business process test.    

 

32)   Do you have business case which you can share (ROI)?

 

We have a number of case studies related to HP solutions for Agile, ALM, Functional testing and performance testing that are available on HP.com in our HP software HP Software customer case study library page here.  If you would like additional insights on ROI specific to your unique use case, please contact your HP representative which will engage our ALM team.

 

33)   Link to the blog would be helpful.    

 

Refer back to our ALM blog here. Thank you!

Discover2013.png

Leave a Comment

We encourage you to share your comments on this post. Comments are moderated and will be reviewed
and posted as promptly as possible during regular business hours

To ensure your comment is published, be sure to follow the Community Guidelines.

Be sure to enter a unique name. You can't reuse a name that's already in use.
Be sure to enter a unique email address. You can't reuse an email address that's already in use.
Type the characters you see in the picture above.Type the words you hear.
Search
Showing results for 
Search instead for 
Do you mean 
About the Author
Kelly has over 20 years experience with enterprise systems and software in individual contributor and manager roles across product manageme...
Featured


Follow Us
The opinions expressed above are the personal opinions of the authors, not of HP. By using this site, you accept the Terms of Use and Rules of Participation.