Lead Big Data Engineer (Databricks)

WE ARE

SoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993. Our associates work on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, make a difference, have fun, and love their work.

Big Data & Analytics Center of Excellence is a data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in the Healthcare, Finance, Manufacturing, Retail, and Energy domains.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others.

IF YOU ARE

• Experienced with Python and PySpark
• Proficient working with Databricks Lakehouse architecture and principles
• Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems
• Experienced with Azure cloud technologies, including Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse, and Azure Data Lake Services
• Skilled with advanced SQL for working with relational databases
• Knowledgeable of database and data warehouse design best practices
• Experienced in designing, building, and scaling streaming and batch data pipelines
• Able to suggest the best solution among different options, conduct trade-off analysis, and solve problems
• Engaging in communication with stakeholders in written and verbal form (upper-intermediate English level)

AND YOU WANT TO

• Be part of a team of data-focused Engineers dedicated to continuous learning, improvement, and knowledge sharing every day
• Work with a cutting-edge technology stack, including pioneering services from major cloud providers that are at the forefront of innovation
• Engage with customers of diverse backgrounds, ranging from large global corporations to emerging start-ups preparing to launch their first product
• Be involved in the entire project lifecycle, from initial design and proof of concept (PoC) to minimum viable product (MVP) development and full-scale implementation

TOGETHER WE WILL

• Address different business and technology challenges, engage in impactful projects, use top-notch technologies, and drive multiple initiatives as a part of the Center of Excellence
• Support your technical and personal growth — we have a dedicated career plan for all roles in our company
• Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Data Community
• Upskill with full access to Udemy learning courses
• Pass professional certifications, encouraged and covered by the company
• Adopt best practices from experts while working in a team of top-notch Engineers and Architects
• Collaborate with world-leading companies and attend professional events