Responsibilities

• Design, develop, and maintain robust data pipelines, ETL processes, and data integration solutions using a combination of different technologies and frameworks such as Azure/AWS, SQL, Python, etc.
• Develop and maintain data models, data warehouses, and data marts to support data analytics and business intelligence activities.
• Ensure data quality and integrity across the entire data lifecycle, from data ingestion to data consumption.
• Select and integrate appropriate data storage technologies, such as SQL or NoSQL databases, and Hadoop-based systems.
• Develop and maintain data processing and analysis tools using programming languages (Python is preferred)
• Design and implement data security and access control mechanisms to protect sensitive data and comply with data privacy regulations.
• Collaborate with clients and stakeholders to understand their business needs and develop data-driven solutions to meet their requirements.
• Help junior data engineers within projects.
• Contribute to the development and improvement of Nortal's data engineering methodologies and best practices.
• Keep up to date with the latest trends and innovations in data engineering and big data technologies and share knowledge with colleagues and clients.
• Collaborate with data, engineering, design, product, and executive teams to assist them with data-related technical issues.

What you will need to succeed:

• At least 2 years of combined data engineering and software development experience (Python background preferred).
• Familiarity with major cloud providers (GCP, AWS, Azure, etc.)
• Experience with Python and related development frameworks
• Experience with SQL and mainstream database platforms (Postgres, MongoDB, Oracle, etc.)
• Familiarity with Docker and Kubernetes
• Understanding and experience with data pipelines, warehousing, and their scalabilities
• Keen on learning and exploring modern technologies/solutions
• Team player with effective communication skills