Presentations feature 1-hour presentations by practitioners, consultants, and industry experts on a range of relevant topics in the software testing industry.
Speaker: Michael Yudanin, Conflair
The need to automate tests for mobile devices is no longer being discussed seriously – it is clear. Yet how can we cope with the formidable challenges the mobile world poses: the head-spinning pace of change, diverse technologies, multiple and still multiplying hardware platforms and operating systems, to name a few?
The solution, it seems, lies not in this or that specific tool but rather in re-considering the approach to automation. Having dozens of hardware platforms, we cannot hope any longer to install full-blown tools on all mobile devices. With the variety of principally different operating systems, we cannot rely any longer on OS-based object recognition, unless we want to have a separate tool for each platform. Hence, the prospect of non-intrusive, remote-control automation comes under serious consideration.
As with almost all other serious issues in testing, mobile test automation requires clear understanding of the challenges we face and turning them into a set of clear guidelines for devising the right test automation method. Hence, during this presentation we will formulate a number of guiding principle for mobile test automation and examine a number of existing automation methods in the light of those principles. Then, I will suggest an alternative framework that can rely on multiple existing tools and allows for automation a variety of hardware and software platforms: mobile, mainframe, ATM, etc., including rather unusual business processes like barcode and check scanning or communication between different types of devices.
The presentation will include a live demonstration of test automation for a mobile device.
Speaker: Tom Cagley, David Consulting Group
Just because you have implemented Agile techniques does not mean you are performing to the level which your organization is capable. Is your implementation of Agile underperforming? Agile has been promoted as delivering higher customer satisfaction, better quality, faster time to market, increased productivity and — in some cases — to deliver world peace. The question is do you know and if you think you know, is your knowledge more than anecdotal? The only way to know truly is to measure.
Measurement is only the first step in finding issues and taking action. Measurement provides focus. Being aware of problems and not spending the time and effort to study performance is a waste. W. Edwards Deming admonished us to have “constancy of purpose.” I would use the term “attention-span” in an attempt to make the same argument. Once we understand we have a problem, our next step is to take action and to perhaps make a difference in the value we deliver. Is your Agile underperforming? It doesn’t matter if you’re not going to fix it.
Key Learning Points
- There are three macro areas that are the typical sources of Agile performance problems: Organization, Processes and Contracts.
- Agile process follow the five basic tenants of an Agile business philosophy: alignment of goals, people, involvement, change and value focus.
- Values and cultures in differences in how people learn and adapt which creates differing expectations of how they want to be managed and how they will tackle problems.
- Measurement and coaching are critical to change and feedback.
Speaker: Kate Slick, CAST
Risk-based testing models are founded on prioritization of functional tests based on their likelihood of failure, the importance of the functionality, and the weighted impact to the business if a failure were to occur. While the merit of this model is proven, it overlooks two vital factors – the structural quality of the system under test and the degree to which complex system objects and transactions have been changed in the development cycle. We will look at these two aspects in more detail including the impact they both have on test effectiveness and production stability.
Key Learning Points
- Identify the root-cause for the majority of defects that result in system failures.
- Understand the importance of quantifying transaction and object risk in addition to risk-based testing.
- Learn how to optimize your test efficiency while expanding your coverage by leveraging structural quality analysis to supplement your risk-based testing.
Speaker: David Johns, SmartBear Software
Code review is often thought of as anti-agile, cumbersome, and disruptive. However, done correctly, it enables agile teams to become more collaborative, effective, and ultimately produce higher quality software faster. David Johns describes how lightweight code review practices succeed where more cumbersome methods fail. He offers tips on the mechanics of lightweight code reviews and compares five common styles of review, presenting research from Karl Wiegers, Frank W. Blakely, Mark E. Boles, and others. He looks at real-world examples, revealing impressive results. Attendees gain new insights into how much time to spend on review, how much to code review in one session, and how author preparation practices can increase the efficiency of a review. Attendees learn how peer code review can improve the performance of individual developers, their teams, and the software they produce, as well as the specific benefits of peer code review, including ROI and the ultimate goal of producing higher quality software faster.
Key Learning Points
Attendees gain an understanding of what makes good code review practice, including:
- The cost of bugs found during software development vs. the cost of fixing them during QA vs. the cost of fixing them after they have reached the customer.
- Optimal amount of code to review at one time.
- Optimal rate of inspection and benefits of author preparation.
Speaker: Jane Connor, Deloitte
In today’s world of wanting to improve revenue, reduce risk, please shareholders and get ahead of the competition, business is demanding more of the projects they commission. In turn project management and steering committees demand efficiency, quality and accuracy of the project components that work together to produce a requested work product. With the increasing complexity of projects to meet business demands, the test effort within the projects have also become more complex and more critical for providing timely information about the quality, completeness and accuracy of the work product. Today, for a test manager to deliver a meaningful project test effort they have to go beyond the technical knowledge required to oversee test development and execution. A test manager also needs project management skills and leadership capability. This presentation will provide an overview of key Project Management Professional (PMP) knowledge areas and team dynamics concepts and explore how they may be leveraged to strengthen the test manager’s influence and control of a test effort.
Key Learning Points
- Treat a project’s test effort as a project within a project
- Leverage existing project management disciplines to gain test management IQ
- Explore the role of the individual and the team to gain test management EQ
Websites and web /mobile applications have become the imperative sales enablers for most organizations. The “optimized user experience” of a website becomes critical for organizations to outperform their competitors. This demands performance testing to be proactive and shift dynamics from measuring responsiveness to improving user experience. Web analytics tools like Google Analytics, Yahoo, Web analytics, etc., are emerging as a one-stop for creating performance testing strategy and design. These tools provide content, conversion, social, advertising, mobile, and other user analytics for application in production. For applications being developed, they provide recommendations from historical web analysis data. Unlike the conventional and ambiguous process of receiving minimal user data from production logs or assumptions, these tools and reports help non-functional testers create a comprehensive strategy and design, resulting in the highest level of user experience and allowing businesses to achieve their objectives. In this session, participants will learn to develop performance test strategies, tools, and techniques to achieve best-in-class user experience.
Key Learning Points
- Learn about the web analytic tools and reports available.
- Creating non-functional requirements and design using web analytic tools.
- Tips, techniques, and best practices to achieve heightened user experience.
Speaker: Murshid Mustafa, ADP
This session is designed to coach the Performance Testing Managers, Leads, and Engineers on how to design a system to produce ‘continuous delivery of performance results’. Often performance engineering teams face challenges fitting into an agile environment. As finding, debugging, and fixing performance issues can take a considerably longer time compared to functional problems. This makes it very critical to expose the issues early in the development cycle. Early failure is cheap and easy to fix. We will learn how we can effectively design a system that can deliver accurate performance results with integrated debugging data. This session will present examples of a working system and real life application performance issues that were caught early in the development cycle in the pre-production environments. Murshid Mustafa will also cover related topics in discussions for results reporting, load tools, data monitoring, and code profiling. The presenter encourages an interactive audience, so bring your questions and come prepared!
Key Learning Points
- How to build an effective delivery system to produce continuous and accurate performance results.
- How can we integrate different monitoring tools to easily debug the issues and review the results?
- How we can operate in agile with an effective performance engineering practice?
- Learn the benefits of early detection of the performance problems.
- Concepts of a fully automated performance results engine.
Tired of testing the same feature over and over again? In an environment where the business is expecting faster turnaround for new features and functionality, the pressure is increasing on quality assurance teams to become more agile.
Learn about “Continuous Inspection” to eliminate over 35% of code related defects hence eliminating redundant tests and enabling QA teams to focus on valuable test cases to reduce overall test cost and increasing application quality without sacrificing timelines. Cloud Continuous Inspection services offer value to both Development and QA teams by making sure that each group can eliminate defects that are in their control and to work together to decrease overall application development costs while increasing quality.
Key Learning Points
- Continuous code quality analysis is possible.
- How to eliminate potential code related defects before investing QA cycles.
- Increase the value of QA by collaborating with development teams through Quality Cloud implementations
Speaker: Yury Makedonov, PhD, Accenture
Because of the recent explosion of smartphone application development, testers are increasingly switching from Windows and browser applications to smartphone applications. These testers can apply their testing skills and experience to the “new” field of smartphone applications. To make them more successful I will discuss unique features of Android applications that should be taken into account. I will also provide some practical tips on tools and techniques. Most ideas from this presentation are also applicable to testing iPhone applications. This presentation is based on my first Android project and the surprises I encountered.
This presentation is for testers who are switching from Windows and browser based applications to smartphone applications.
Speaker: Jeremy Berriault, Manulife Financial
Within any business project, relationships are built that can have a lasting impact, not only within the project team, but within the organization. In this environment, external relationships must be strong to ensure that the organization’s strategy and vision are met. Positive internal associations ensure efficient management of internal projects preventing over run budgets, reduction of scope, and overextended timelines. A key internal relationship that should be strongest is that of Business and Testing groups (IT); yet there is a gap that results in rework and cost increases. This meta-analysis considered studies which focused on Knowledge Gap and Perceptions between Business and IT groups. Correlation of the findings proved significant in the development of team relationships which improved product quality and decreased cost. Three main factors: trust, value, and knowledge gap were identified as areas of agitation in any organizational structure. This presentation will review those concepts with respect to the available data and provide solutions through identification of recognized strategic and operational management models. Role and job perception play a large part in development of relationships between disciplines as well as with external clients. Marketing tools for internal and external resources will be discussed which will assist Business and IT to share knowledge, improve trust and increase perceived value in their respective roles.
Key Learning Points
To improve the strength of the relationship, recommendations are outlined involving testing and business leadership. This will improve communication and understanding, ultimately resulting in the development and production of a stronger end product. Although the term marketing management is normally focused on attracting clients, it is recommended that testing consider sharing information about the value of their role within the organization. Strategic management models are identified to assist business and testing methods for achieving a partnership with equal involvement that values the strength of the other to succeed. Bi-directional communication is advocated to ensure knowledge sharing, collaborative decision making and appropriate quality assurance practice that will reconnect these groups and benefit the organization.
Speaker: Adam Gallant, Microsoft
Complex testing environments are become the norm, yet so is the desire by testers to be able to respond to needs of the organization in a more agile way. Cloud services provide capabilities to testers to reduce time to testing through rapid environment creation, as well as the ability to set up and use variations on core environments to handle different client scenarios. In this session, we’ll talk through the application of cloud services to address the needs to testers, from manual and automated test, to stress/load testing, and we’ll demonstrate some of these concepts.
Speaker: Hang Lin, Meritain Health
The test solutions engineering program is an initiative to streamline quality control activities and deliverables to drive efficiency and effectiveness in an organization. It establishes a repeatable process for driving quality and creates an environment for business engagement and partnership. In this presentation, we will look at steps for establishing a TSE program and offer a foundation for continuous improvement.
Key Learning Points
- Test Solutions Engineering program overview.
- Why is it important?
- How we can measure the effectiveness of TSE program.
Speaker: Tenveer Hussain, TEKsystems
Testing of Data Warehouse (DW) systems is a burning and important topic as companies are consolidating all of their data and seeing their business trends based on that data, and making decisions accordingly. They want to see correct and complete data without any surprises; hence, there is a need to have robust testing and more focus on test data. From a testing point of view, it is very critical to understand the source systems and management of test data to effectively test and make sure a quality system is delivered. Use of bad or incomplete data will lead to poor quality, ultimately affecting the decision making process. Managing and choosing the right data at each step of data warehouse process (i.e. Extract Transform and Load (ETL) and Business Intelligence (BI) Reports) has a vital role in successful DW projects. This includes delivering to the business right on schedule without compromising the quality. Tenveer Hussain will cover some of the challenges faced in DW testing related to the test data that comes across in different data warehouse projects, and will discuss some of the lessons learned. Data Quality is another important aspect that needs to be taken care of while testing the DW systems.
Key Learning Points
- Importance of test data management in delivering a quality data warehouse system. What should be considered when planning, analyzing, and managing test data?
- Considerations and recommendations for test approach and strategy in planning for data warehouse (ETL and BI) testing.
- Challenges and their practical solutions faced in the process of data warehouse testing and test data management.
Speaker: Dana Armstrong, Nationwide Insurance
This presentation will take attendees through a two week sprint as our web development team dives into the stories starting with the tasking session and ending with the completion of the committed stories for an iteration. At first glance all looks great, but evil is lurking below and it is ok to admit it. The Agile Process is a wonderful methodology to follow introducing concepts such as Acceptance Test Driven Development (ATDD), pairing and retrospectives. It is a very adaptive process in that there are as many ways to practice Agile as there are participants practicing it. However, there are underlying factors that reduce its effectiveness: different sprint schedules, release schedules, external team dependencies, effectively communicating retrospective findings and losing sight of the bigger picture. Dana Armstrong will offer suggestions on how to diffuse some of these factors to help you become a better Agile practitioner. He will share the survey sent to his Business Solution Area with 400+ employees. The results will show their reaction to the Agile Process and comments on how it can be improved, broken down by roles within the teams including requirements and testing, application development, iteration managers, and management.
Key Learning Points
- One of the premises of Agile is to fail fast. Retrospectives are a great medium for capturing the successes and failures of your sprint, but how does anyone else know what you’ve tried and vice versa? By using social media, such as Yammer or Twitter, you can open your team’s Retrospective findings for others in your company to see and learn from.
- Creating story cards leads to the faster development and testing of a particular story. It is cautioned to understand the bigger picture. This story is a piece of a requirement, but how does it fit into your application or the project as a whole? Simply testing the story fails to account for the countless iterations that it may have, and understanding how the story fits in will help you test it better.
- The practice of Acceptance Test Driven Development (ATDD) is another benefit of the Agile Process, although anyone can practice this. Have you considered how much testing is actually duplicated? During your tasking sessions, discuss what your developers are covering in their j-unit tests and cover other scenarios to help maximize your test coverage.
Today’s application portfolios are complex, often made up of a multitude of interrelated technology platforms and applications. Understanding the impact of change within and across these platforms presents an ongoing, serious challenge. Organizations deploy dozens of QA personnel to painstakingly ensure production releases are sound and safe, involving significant manual effort. Application cartography can map the full application portfolio, regardless of technology or language, including support for non-standard or even home-grown components that otherwise have limited or no tool support. It thus creates a comprehensive analysis (and knowledge) environment that can be used to understand impacts of change easily and effectively.
Components of the technology specifically designed to support the QA process will be presented and demonstrated, such as support for automatically identifying all impacts of a change across technology platforms, the ability to automatically identify the required test cases and seamless integration with already existing QA processes and environments.
Key Learning Points
- How to automatically identify impacts of a change across technology platforms
- How to ensure proper test coverage in complex technology environments
- How to leverage a knowledge repository to continuously improve your QA processes