• Design, develop, and implement robust and scalable
• data pipelines using Azure services such as Azure Data Factory, Azure Databricks, Azure Cosmos DB, Azure SQL Database, and other relevant services.
• Develop and maintain data models, schema, and data quality processes.
• Collaborate with stakeholders to define and understand data requirements.
• Develop and implement data governance policies and
• procedures.
• Troubleshoot and resolve data-related issues and performance bottlenecks.
• Stay up-to-date on the latest Azure technologies and best practices.
• Contribute to the development and maintenance of documentation and technical standards.
• Participate in code reviews and provide technical guidance to team members.

Mandatory skill sets:

• Spark framework, PySpark, Azure Databricks, Azure SQL Database, ADF, Storage Account, Azure Data Explorer