T E S T Q

Technical Architect - Data Science 

Job Description:

Job Description (Main Duties and Responsibilities): 

  • Automating use cases using ICEDQ testing tool, performance enhancement by SQL query optimization. 
  • Migrating Big Data Hive and Impala ETL scripts into PySpark. 
  • You will work with/lead a team of outstanding specialised software engineers to help build and run great software solutions, applications, and products specially in area of data management in relational database (Oracle, MySQL) and nonrelational data storage for data analysis including data cubes generation, data visualization.  
  • Responsible for data analysis using Microsoft analytical studio (SSAS) for generating reports using Power BI, Tableau and SSRS.  
  • Working in Continuous Integration and Continuous Deployment process for supporting cloud technology [AWS]. 
  • Responsible for preparing ETL dataflow pipelines using SSIS and Informatica, monitoring, and production support fixes.  
  • Responsible for development and enhancement of database packaging and stored procedures.  
  • Ensure the team produce high quality, well-tested software that conforms to all technical guidance and standards.  
  • Ensure any reusable code created and any innovative work done within the team is communicated.  
  • Coordinate with team and develop database packages and stored procedures to generate dynamic SQL query using mid tear Java application.  
  • Responsible for preparation of shell scripts to automate the migration of Informatica and UNIX code from lower environment to higher environments during the release of code.  
  • Responsible for generating ad hoc weekly and monthly reporting files for third party vendors and FTP using FileZilla.  
  • Responsible for Disaster Recovery switch process by preparing shell scripts.  
  • Be involved in some of organisation wide tasks like technical support and process improvement programs.  

Key Skills, Qualifications and Experience Needed [The candidate must demonstrate these in all stages of assessment] 

  • Should be expert in the following technologies: Oracle Pl/SQL, ETL Informatica/SSIS, PySpark, AWS.  
  • Good knowledge of cloud concepts like Lambda function, Javascript, Ansible.   
  • Should be expert in following technologies R, Python, Hive, Web Services, NoSQL.  Databases: HBASE, Cassandra & MongoDB.  
  • Exposure to industry best practices, any government/client required/specified standards, internal development guidelines and aligns with the strategic vision of the organisation.  
  • Ability to understand the Software design frameworks and patterns; Version controlling.  
  • Understanding of the full development life cycle and how various DevOps tools are used in the development including dev, testing, QA, deployment, and event configuring environments.  
  • Strong unit and integration testing skills in normal or CI/CD environment.  
  • Experience with code analysis tools and professional comfort level in using services like GitHub.  
  • Strong debugging skills for functional testing.  

Other Key skills: 

  • Good analytical and Problem-solving skills 
  • Good communication skills 
  • A thorough approach and Self starter 
  • Focus on quality and delivery 
  • Working together in teams. 
  • Leadership and effective decision making. 
  • Flexible Attitude 
  • Excellent customer service