Roles open

• Engineer – 1–2 years of experience building enterprise-grade data processing applications
• Senior Engineer – 3+ years of experience, with the ability to lead technical design, guide POD members and mentor engineers

What you'll do

• Design, build and maintain scalable data pipelines across multiple source systems
• Develop distributed, highly available data processing applications on GCP
• Own solutions end to end – development, QA, deployment and post-production support – following CI/CD and DevOps practices

What you'll bring

• Bachelor's in Computer Science (or equivalent) with enterprise data processing experience (1–2 years for Engineer; 3+ years for Senior Engineer)
• Strong Python, Shell and SQL; experience with large data volumes and relational/NoSQL databases
• Hands-on ETL/ELT experience (Airflow, Cloud Composer, Dataflow, Dataproc, Spark, Glue or similar)
• GCP experience – BigQuery, Pub/Sub, Cloud Functions, Cloud Run
• Git/GitLab/Jenkins, Scrum and strong communication skills

Additionally for Senior Engineer

• Proven ownership of end-to-end data pipeline design on GCP, from architecture to production
• Ability to align POD members on technical vision and path to implementation
• Mentoring engineers and driving code quality, CI/CD and DevOps best practices

Nice to have

• Streaming data (Kafka, Pub/Sub, Spark Streaming), Datadog monitoring, and data warehouse / lake / mesh experience

Ready to apply? Send your CV to careers@acentura.com with the subject line "Engineer – Data Engineering" or "Senior Engineer – Data Engineering".

Full Job Description – Engineer / Senior Engineer, Data Engineering

Responsibilities

• Designing and developing data solutions for one of the world's largest corporations involved in the marketing and distribution of food products
• Implementing distributed and highly available data processing applications that scale for enterprise demands on Cloud Services such as GCP
• Design, develop and maintain data pipelines integrating multiple source systems and targets
• Adhering to Continuous Integration and Continuous Delivery of solutions
• Ensuring high code quality by following software engineering best practices
• Working collaboratively in a cross-functional team in an Agile delivery environment
• Adhering to DevOps principles and being involved in projects throughout their full software lifecycle: from development, QA, and deployment to post-production support

Requirements

• A Bachelor's Degree in Computer Science or equivalent, and 1–2 years (Engineer) or 3+ years (Senior Engineer) of experience in developing enterprise grade data processing applications
• A strong programming background in data ops (Python, Shell, SQL)
• Experience in processing large volumes of data
• Hands-on experience working with relational/NoSQL databases and distributed storage engines
• Hands-on experience in ETL/ELT design and development using ETL/ELT tools such as but not limited to Airflow, Google Cloud Services such as Cloud Composer, Cloud Dataflow, Cloud Dataproc and Amazon Web Services such as Data Pipelines, Glue, Lambda, EMR, Spark, Hive
• Experience in working with streaming data (using tools such as Pub/Sub, Kafka, Storm, Spark) will be an added advantage
• Hands-on experience with Google Cloud Platform (GCP): Experience with services & serverless functions (e.g., BigQuery, Datastream, DataFlow, Pub/Sub, Cloud Functions, Cloud Run, Cloud Composer, etc.) for data processing and orchestration
• Experience working in a Scrum Agile delivery environment and DevOps practices
• Experience in code management and CI/CD tools such as GitHub, GitLab and Jenkins
• Experience in an agile environment and aligning POD members on technical visions and path to implementation
• A strong desire to continue to grow your skillset
• Strong communication skills that are influential and convincing
• Experience with application monitoring (Datadog, or equivalent) will be an added advantage
• A passion for building and maintaining data solutions (data warehousing, data marts, data lakes, data mesh) will be an added advantage