Responsibilities

• Develop and maintain data solutions using Databricks SQL to ensure efficient data processing and querying.
• Implement and manage Databricks Workflows to automate data pipelines and ensure seamless data integration.
• Utilize PySpark to build and optimize large-scale data processing applications.
• Collaborate with data engineers and analysts to understand data requirements and deliver solutions that meet business needs.
• Ensure data quality and integrity by implementing robust validation and testing procedures.
• Monitor and troubleshoot data workflows to identify and resolve issues promptly.
• Optimize data processing performance to enhance system efficiency and reduce processing times.
• Provide technical support and guidance to team members on Databricks and PySpark-related tasks.
• Document data solutions and workflows to ensure knowledge sharing and maintain project transparency.
• Stay updated with the latest advancements in Databricks and PySpark technologies to incorporate best practices.
• Participate in code reviews to ensure code quality and adherence to standards.
• Contribute to the continuous improvement of data processes and workflows.
• Communicate effectively with stakeholders to understand project requirements and deliver solutions that align with business goals.

Qualifications

• Must have strong experience with Databricks SQL for efficient data querying and processing.
• Must have hands-on experience with Databricks Workflows for automating data pipelines.
• Must be proficient in PySpark for building and optimizing large-scale data processing applications.
• Nice to have experience with data validation and testing procedures to ensure data quality.
• Nice to have experience in troubleshooting and optimizing data workflows for enhanced performance.
• Nice to have excellent communication skills to collaborate with team members and stakeholders.
• Nice to have a proactive approach to staying updated with the latest data technologies and best practices.

Certifications Required

Databricks Certified Associate Developer for Apache Spark Databricks Certified Data Engineer Associate

The Cognizant community:
We are a high caliber team who appreciate and support one another. Our people uphold an energetic, collaborative and inclusive workplace where everyone can thrive.

• Cognizant is a global community with more than 300,000 associates around the world.
• We don’t just dream of a better way – we make it happen.
• We take care of our people, clients, company, communities and climate by doing what’s right.
• We foster an innovative environment where you can build the career path that’s right for you.