Medior Data Engineer

SmartCat is an AI-driven company that tackles complex data challenges with innovative solutions. Our expert team collaborates on carefully selected projects that deliver measurable, positive impacts on businesses, everyday life, and society.

Position Overview:

We are seeking a talented Medior Data Engineer to join our team. In this role, you will contribute to building and maintaining our data lakehouse infrastructure using Spark and Databricks. You will be involved in implementing data pipelines and supporting the efficient processing and storage of large datasets.

Key Responsibilities:

• Assist in designing and building scalable data pipelines using Apache Spark and modern data platforms.
• Develop and maintain data lakehouse architectures to support data analytics and machine learning workflows.
• Contribute to the development of data models and structures that ensure data quality and consistency.
• Work alongside senior engineers, data scientists, and analysts to understand data requirements and implement solutions.
• Help ensure data security and compliance with relevant regulations.
• Assist in monitoring and troubleshooting data pipeline performance.
• Participate in improving data engineering processes and adopting best practices.
• Collaborate with cross-functional teams and contribute to technical discussions.

Requirements:

• 1-3 years of experience in data engineering or related fields.
• Proficiency in Python or Scala/Java.
• Solid knowledge of SQL.
• Experience with Apache Spark, Databricks, Snowflake, or Microsoft Fabric.
• Understanding of data lakehouse concepts and architecture.
• Familiarity with distributed systems fundamentals.
• Basic data modeling and data warehousing skills.
• Exposure to cloud-native data architectures (AWS, Azure, or GCP).
• Familiarity with Kafka, Flink, or similar streaming technologies is a plus.
• Basic understanding of Kubernetes is a plus.
• Exposure to Vector Databases is a plus.
• Interest in Machine Learning is a plus.
• You enjoy learning new things and trying different solutions.
• You value a healthy work-life balance; we don’t like overtime.
• You know when and how to ask for help; we work together as a team.

What we offer:

• Clearly defined pay grades: from L1 (talented junior) to L10 (principal)
• The career path that connects these grades – you know where your life is going (at least here with us)
• Loyalty coefficient: 10% on net compensation after 3 years in SmartCat, 20% on net compensation after 5 years
• Knowledge budget: extra money for conferences, books and training of your choice
• Flexible working hours and work from home 
• End of the year bonus program 
• We are transparent – from L-levels to salary, strategy, financial reports, and beyond
• You will have our full support towards gaining expertise
• An excellent team of senior engineers and data scientists