Senior Data Engineer (Remote)

🌟 Senior Data Engineer 🌟

🚀 About A5 Labs

A5 Labs is the advanced technology hub behind the screen of the most prominent mobile gaming companies in the world. We make the online gambling future possible by developing top-quality security technology and coding innovative game designs.  At A5 Labs, we are all about creating exceptional AI-driven experiences that set new industry standards. If you have ever indulged in online casino games, chances are you have already come across our technology and innovation.

The Role:

As a Senior Data Engineer, you'll play a pivotal role in expanding and optimizing our data services. You'll ensure optimal data flow and empower cross-functional teams by creating robust data analytical pipelines that meet stringent requirements and facilitate data delivery across diverse systems. This position requires deep expertise in data engineering, particularly with Python, PySpark, and SparkSQL, combined with SQL/NoSQL storage optimizations and hands-on experience applying best practices in data architecture, data structures, algorithms, and design patterns.

What You’ll Do:

• Design and build highly optimized data analytical pipelines to support various products, ensuring efficient data flow and delivery across cross-functional teams.
• Create and maintain optimal data pipeline architecture, including infrastructure for scalable ETL/ELT processes.
• Process large and complex datasets to meet both functional and non-functional business requirements for analytical and operational use cases.
• Identify, design, and implement improvements to data engineering processes, focusing on: Optimizing data delivery, Redesigning infrastructure for scalability, Introducing and adhering to data engineering best practices.
• Proactively monitor, troubleshoot, and optimize the performance of data pipelines and infrastructure to ensure efficiency, reliability, and adherence to performance SLAs.
• Collaborate with data and analytics experts, AI teams, and product teams to deliver high-quality data pipelines within project timelines.
• Conduct code reviews and refactor existing code to align with industry standards, emphasizing clean, maintainable, and scalable solutions.
• Mentor junior and mid-level data engineers by guiding them on: Coding practices, Design principles, Problem-solving techniques.
• Maintain detailed documentation of code, processes, and configurations, ensuring knowledge transfer and transparency across teams.

• 5+ years of hands-on Data Engineering experience, with a proven track record in building, optimizing, troubleshooting, and performance testing large-scale data pipelines.
• Deep expertise in Python development for data engineering (PySpark, SparkSQL, Pandas, NumPy), coupled with Big Data technologies such as Databricks, Spark, and Hive.
• Strong proficiency with SQL and NoSQL databases (e.g., PostgreSQL, MongoDB), ETL/ELT tools and data warehousing solutions (e.g., AWS Redshift, ClickHouse, Snowflake).
• Hands-on experience with AWS services (e.g., S3, KMS, Redshift, RDS, ECS) and robust understanding of containerization technologies.
• Experience with workflow orchestration tools like Apache Airflow for managing complex data processes.
• Excellent analytical skills with a history of extracting value from complex datasets, complemented by a solid understanding of data modeling and storage techniques.
• Strong foundation in data engineering principles, including testing strategies, clean code practices, and DevOps/DataOps principles for reliable data systems.
• Proficient in English for effective collaboration with diverse teams and international stakeholders.
  
  

• Experience building microservices in Python using frameworks like FastAPI and Flask
• Familiar with streaming systems and tools such as Spark-streaming, Kafka-stream, Flink
• Exposure to AI and machine learning workflows or interest in working alongside AI-focused teams.
• Interest in the gaming industry or prior experience in iGaming platforms.