We have French content available. View French site.

Lead Data Engineer, AI, Insights & Solutions

Employment type

Permanent Full-Time

Location(s)

São Paulo

São Paulo

Description & Requirements

Applications must be submitted in English

ABOUT US

Bain & Company is a global consultancy that helps the world’s most ambitious change-makers define the future.

Across 65 cities in 40 countries, we work alongside our clients as one team with a shared ambition to achieve extraordinary results, outperform the competition, and redefine industries. We complement our tailored, integrated expertise with a vibrant ecosystem of digital innovators to deliver better, faster, and more enduring outcomes. Our 10-year commitment to invest more than $1 billion in pro bono services brings our talent, expertise, and insight to organizations tackling today’s urgent challenges in education, racial equity, social justice, economic development, and the environment. We earned a platinum rating from EcoVadis, the leading platform for environmental, social, and ethical performance ratings for global supply chains, putting us in the top 1% of all companies. Since our founding in 1973, we have measured our success by the success of our clients, and we proudly maintain the highest level of client advocacy in the industry. 


WHO YOU'LL WORK WITH

As a member of Bain’s Advanced Analytics Group, you’ll join a talented team of diverse and inclusive analytic and engineering professionals who are dedicated to solving complex challenges for our clients. We work closely with our generalist consultants and clients to develop data-driven strategies and innovative solutions. Our collaborative and supportive work environment fosters creativity and continuous learning, enabling us to consistently deliver exceptional results.


WHAT YOU’LL DO

As a Lead Data Engineer, you will leverage your experience to implement and refine technical solutions for a wide range of industries. Working with a diverse team, you will engage in the entire engineering life cycle, focusing on designing, developing, optimizing, and deploying sophisticated data engineering solutions and infrastructure at a production scale suitable for the world’s largest companies. Also, you will leverage your extensive experience to lead data governance projects and develop end-to-end data solutions. This includes setting up robust frameworks and ensuring their adoption by our clients, and designing and building the data solutions and architectures on various cloud providers.


ABOUT YOU

Technical Skills and Knowledge:

  • Proven experience in end-to-end data and software engineering within either/or product engineering or professional services organizations; including project setup, test cases, dependency, and build management 
  • 5 years minimum experience in relevant data engineering roles (3+ years at Senior or Staff level, or equivalent)
  • Working knowledge of (3+ years) Python, Scala, C/C++, Java, C#, Go, or similar programming language
  • Experience in deploying serverless data pipelines through containerization and terraform orchestration 
  • Experience in data ingestion using one or more modern ETL compute and orchestration frameworks (Airflow, Beam, Luigy, Spark, Nifi or any other)
  • Experience (3+ years) of  SQL or NoSQL databases: PostgreSQL, SQL Server, Oracle, MySQL, Redis, MongoDB, Elasticsearch, Hive, HBase, Teradata, Cassandra, Amazon Redshift, Snowflake
  • Experience with Cloud platforms and services (AWS, Azure, GCP, etc.) or Kubernetes via Terraform automation, and associated deep understanding of failover, high-availability, and high scalability  
  • Experience with DevOps, CI/CD, Github Actions, version control and git workflows
  • Experience scaling and optimizing schema and performance turning SQL and ETL pipelines in data lake and data warehouse environments
  • Strong computer science fundaments in data structures, algorithms, automated testing, object-oriented programming, performance complexity, and implications of computer architecture on software performance
  • Experience working according to agile principles


Interpersonal Skills:

  • Professional level proficiency in speaking, reading, and writing in English
  • Strong interpersonal and communication skills, including the ability to explain and discuss technicalities of solutions, algorithms, and techniques with colleagues and clients from other disciplines
  • Curiosity, proactivity, and critical thinking
  • Ability to collaborate with people at all levels and with multi-office/region teams 


Education

  • Bachelor's or Master’s degree in Computer Science, Engineering, or a related technical field


WHAT MAKES US A GREAT PLACE TO WORK

We are proud to be consistently recognized as one of the world's best places to work, a champion of diversity and a model of social responsibility. We are currently ranked #1 on Glassdoor's Best Places to Work list, and we have maintained a spot in the top four on Glassdoor's list for the last 13 years. We believe that diversity, inclusion and collaboration is key to building extraordinary teams. We hire people with exceptional talents, abilities and potential, then create an environment where you can become the best version of yourself and thrive both professionally and personally.  We are publicly recognized by external parties such as Fortune, Vault, Mogul, Working Mother, Glassdoor and the Human Rights Campaign for being a great place to work for diversity and inclusion, women, LGBTQ and parents.