Log In
Sign Up
- 3 – 10 years of Python data engineering experience
- Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc., on AZURE.
- Experience in developing ETL, OLAP based and Analytical Applications.
- Experience in ingesting batch and streaming data from various data sources.
- Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)
- Ability to quickly learn and develop expertise in existing highly complex applications and architectures.
- Experience in Azure Data Factory (ADF), Azure Data Brick, Azure Synapse, Azure SQL, Azure DWH, Azure Data Lake Storage / Analytics, Azure Database Migration Services
- Experience of DevOps and CD/CD tools.
- Bachelor’s degree in computer science, information technology, or a similar field.
- You will need to be well spoken and have an easy time establishing productive long lasting working relationships with a large variety of stakeholders
- Take the lead on data pipeline design with strong analytical skills and a keen eye for detail to really understand and tackle the challenges businesses are facing
- You will be confronted with a large variety of Data Engineer tools and other new technologies as well with a wide variety of IT, compliance, security related issues.
- Design and develop world-class technology solutions to solve business problems across multiple client engagements.
- Collaborate with other teams to understand business requirements, client infrastructure, platforms and overall strategy to ensure seamless transitions.
- Work closely with AI and A team to build world-class solutions and to define AI strategy.
- You will possess strong logical structuring and problem-solving skills with expert level understanding of database and have an inherent desire to turn data into actions.
- Strong verbal, written and presentation skills
- Familiarity with Rest APIs
- Clear and precise communication skills
- Experience with CI/CD pipelines, branching strategies, & GIT for code management
- Comfortable working in Agile projects