背景
Nowadaysthere are so many applications in iOS platform and become more and morepopular, but due to the specificity and security of iOS platform, there are fewgood frameworks for test automation of iOS, we design a TA solution on iOSwhich is suit for iPhone/iPad meeting client automation testing.
功能
We can use it dobasic feature before meeting and in-meeting feature. Also can do simpleperformance test and get the data of CPU, memory usage.
We use automated testing for features, can save lots of effort. e.g. we need 5hours to execute 100 test cases manually, but use TA it only costs 1.6 hours,can save nearly 68% effort.
BasicFeature
Ø Sign in/sign out
Ø Schedule/start/join/leave/end/delete meeting
Ø Invite/expel attendee
Ø Make presenter
In-meetingFeature
Ø Join VoIP audio
Ø Mute/unmute/mute by host
Ø Send/stop video
Ø Switch camera
性能測試
Previously,we use third-part tool test audio/video or other performance data, andsometimes the data that we get from tool always is imprecise, but use TA we canget real-time and accurate data in meeting.
1） Get the performance data of CPU, memory etc.of iPhone/iPad when presenter sharing PD/AS and send video/audio in meeting.
2） Generate a report for these data, and writeinto excel document.
生成測試報告
At last,after finish the TA scripts run, can generate a report on server for all thetest result, includes the percentage of case passed or failed, finally sendemail for notice the user.
框架
The techniqueprinciple is uncomplicated. First, create connection between PC and ourapplication though socket which embedded in iOS app, we call it TALib, everydevice have different IP address as the flag of connection.
Then use Pythonscripts call application interface which encapsulated previously and executerelated operation on iPhone or iPad device. Also can do interactive operationwith PC though call XMLAPIs and ASKTool.
創新
Our TA solution isbased on the logic of meeting process, not depend on UI change due to versionupgrade, so it has high reusability and reliability.
Another is our TAframework can ingrate with other tools, e.g. ASKTools, or MMP video tool, so ithas good expandability.
At last, we can visitTA report address, and view all the test result, includes the percentage ofcase passed or failed, finally send email for notice the user.
風險
There are some risks in this project when wedesign the solution, as following
1. Basedon network
2. Usespecial test build
3. Otherexceptions, e.g. memory leak, app crashed.
團隊合作
Our members from 3different teams in this iOS TA project, includes iOS develop team, iOS QA teamand TA team, work in cooperation.
Developmember: provide the detail action APIs
TAmember: packaging the APIs with Python script
QAmember: write TA scripts and run case
請看 iOS TA Solution (二)