We are searching for top talent that will help us in building cutting-edge products that solve the most challenging problems in the IT world. You will have access to large sets of complex data and utilize your skills in developing/supporting high performance data ingestion pipelines, data modelling, integrations with services, automating processes using python and collaborating with business teams to create scalable solutions as per business requirements.

What you’ll do:

• Develop and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
• Created backend functions that help automate some of the complex data related processes.
• Build and configure web services, pub-sub queues, Event Driven Architecture components.
• Follow best practices and industry standards while implementing Data Engineering and Mastering functions.
• Analyze business requirements and lead the effort in solutioning the product design including creating architecture that is scalable.
  
  

What you will need:

• 5+ years of working experience.
• Experience in OOPS concept, Data structure and design (architecture, design patterns and scaling)
• Strong SQL skills, ability to create Functions/Stored Procedures and effective querying involving multiple tables and subqueries.
• Experience creating detailed architecture diagrams and solutioning for data-based products.
• Experience working with Bigdata using libraries like PySpark, Hadoop.
• Strong Python programming experience and knowledge of Python Frameworks like Pandas, Numpy and Python data processing libraries.
• Experience with Data Pipelining, Data Transformation, ETL and creating custom Python data pipelines.
• Good experience working with AWS Cloud and it’s services related to Data engineering like Athena, AWS batch jobs etc.
• Proven ability to use data, analytics, and business knowledge to solve complex business problems.
• Experience of data modeling and working with data warehouses.
  
  

Good to have:

• Data visualization experience with tools like PowerBI, Tableau.
• Experience working with PostgreSQL database.
• Familiarity with HBase, MapReduce, and other suitable platforms.
  
  

What you will get:

• Competitive salary, generous paid time off policy, charity match program, Group Medical Insurance, Parental Leave, Employee Assistance Program (EAP) and more!
• Collaborative, team-oriented culture that embraces diversity
• Professional development and unlimited growth opportunities