Senior Data Engineer (with DataBricks and Azure)

*This position is fully remote only for employment in Bulgaria. However, people can also work in one of our offices in Sofia or Varna if they prefer to.

About DataArt

DataArt is a global software engineering firm and a trusted technology partner for market leaders and visionaries. Our world-class team designs and engineers data-driven, cloud-native solutions to deliver immediate and enduring business value.

We promote a culture of radical respect, prioritizing your personal well-being as much as your expertise. We stand firmly against prejudice and inequality, valuing each of our employees equally.

We respect the autonomy of others before all else, offering remote, onsite, and hybrid work options. Our Learning and development centers, R&D labs, and mentorship programs encourage professional growth.

Our long-term approach to collaboration with clients and colleagues alike focuses on building partnerships that extend beyond one-off projects. We provide the ability to switch between projects and technology stacks, creating opportunities for exploration through our learning and networking systems to advance your career.

Position Overview

Our client is a premier home improvement company, boasting a network of over 2,000 stores across eight European countries. You’ll be part of an organization that values innovation and teamwork, where you contribute to the company’s success, not just a single project.

Working in a cross-functional team using the Agile framework to design, build, and maintain a home improvement solution.

Data Engineer will offer engineering support and deliver data insights through the collection, analysis, and summarization of development and service issues. Your expertise will help steer the direction of our data strategies and ensure the highest quality in our technology offerings.

As a Senior Data Engineer, you’ll integrate into a dynamic data engineering team led by an experienced Data Lead. Your new team is a blend of talented Data Engineers, Data Designers, meticulous QA experts, and an agile Scrum Master, all dedicated to building exceptional data solutions.

Responsibilities

• Design, build, and maintain ETL processes, transforming raw data into actionable insights
• Manage and optimize large-scale data pipelines, ensuring data quality and integrity
• Develop and optimize SQL queries for efficient data extraction, transformation, and analysis
• Collaborate with cross-functional teams to understand data requirements and implement effective data solutions
• Utilize Python and PySpark for data engineering tasks, including scripting and automation
• Leverage Azure Databricks for advanced data processing and analytics
• Monitor, troubleshoot, and optimize data workflows to ensure high performance and reliability

Requirements

• Proven experience as a Data Engineer in a professional, production environment
• Strong programming skills in Python and a solid understanding of ETL processes
• Advanced proficiency in SQL and experience working with large datasets
• Hands-on experience with Azure Databricks and Azure Data Factory (ADF)
• Solid understanding of data modeling, data warehousing concepts, and performance tuning
• Strong expertise in Databricks, including Delta Tables and Delta Live Tables
• Advanced programming skills in Python and PySpark
• Experience with Unity Catalog
• Proficiency in DBT (Data Build Tool)
• Solid knowledge of Medallion Architecture

Nice To Have

• Experience with data governance and data cataloging tools
• Familiarity with CI/CD practices and version control systems (Git)
• Understanding of data security and privacy best practices
• Experience with additional cloud services or platforms

What We Offer

• Unique corporate culture – no micromanagement, friendly atmosphere, freedom, and mutual respect
• Flexible schedule – ability to change projects, to work from home, and to try yourself in different roles
• Professional Development Map – a comprehensive map of your professional development within DataArt
• We hire people not for a project, but for the company. If the project (or your work in it) is over, you go to another project or to a paid “Idle”.
• Social benefits – additional health insurance, life insurance, sports card, etc.
• Opportunity to work from another DataArt office in a different city or country (temporarily or permanently)
• Free English courses
• Cozy office with a great atmosphere
• Snacks, drinks, and fruits are always available

^{reference number: DE00135}