Data Engineering Lead

3 weeks ago

Delhi, India Atrium Full time
Unlock yourself. Take your career to the next level.
At Atrium, we live and deliver at the intersection of industry strategy, intelligent platforms, and data science — empowering our customers to maximize the power of their data to solve their most complex challenges. We have a unique understanding of the role data plays in the world today and serve as market leaders in intelligent solutions. Our data-driven, industry-specific approach to business transformation for our customers places us uniquely in the market.
Who are you?
You are smart, collaborative and take ownership to get things done. You love to learn and are intellectually curious in business and technology tools, platforms and languages. You are energized by solving complex problems and bored when you don’t have something to do. You love working in teams, and are passionate about pulling your weight to make sure the team succeeds.
What will you be doing at Atrium?
In this role, you will join the best and brightest in the industry to skillfully push the boundaries of what’s possible. You will work with customers to make smarter decisions through innovative problem-solving using data engineering, Analytics, and systems of intelligence. You will partner to advise, implement, and optimize solutions through industry expertise, leading cloud platforms, and data engineering.
As a Lead Data Engineering Consultant, you will be responsible for expanding and optimizing the data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. You will support the software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.
In this role, you will:
Create and maintain optimal data pipeline architecture
Assemble large, complex data sets that meet functional / non-functional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, DBT, Python, AWS, and Big Data tools
Development of ELT processes to ensure timely delivery of required data for customers
Implementation of Data Quality measures to ensure accuracy, consistency, and integrity of data
Design, implement, and maintain data models that can support the organization's data storage and analysis needs
Deliver technical and functional specifications to support data governance and knowledge sharing
In this role, you will have:
Bachelor’s degree in Computer Science, Software Engineering, or equivalent combination of relevant work experience and education
4-8 years of experience delivering consulting services to medium and large enterprises. Implementations must have included a combination of the following experiences:
Data Warehousing or Big Data consulting for mid-to-large-sized organizations.
Strong analytical skills with a thorough understanding of how to interpret customer business needs and translate those into a data architecture
Strong experience with Snowflake and Data Warehouse architecture preferred
SnowPro Core certification is highly desired
Hands-on experience with Python (Pandas, Dataframes, Functions)
Hands-on experience with SQL (Stored Procedures, functions) including debugging, performance optimization, and database design
Hands-on experience with Snowflake data loads
Experience with data analysis and data processing using Python & Snowflake
Experience with creating User defined functions using Snowflake SnowSQL
Experience with SQL optimization, workload management using Snowflake
Strong Experience with Apache Airflow and API integrations
Experience with leading and mentoring junior data engineers
Solid experience in any one of the ETL/ELT tools (DBT, Mulesoft, FiveTran, AirFlow, AirByte, Matillion, Talend, Informatica, SAP BODS, DataStage, Dell Boomi, Mulesoft, FiveTran, Matillion, etc.)
Nice to have: Experience in Docker, DBT, data replication tools (SLT, HVR, Qlik, etc), Shell Scripting, Linux commands, AWS S3, or Big data technologies
Strong project management, problem-solving, and troubleshooting skills with the ability to exercise mature judgment
Enthusiastic, professional, and confident team player with a strong focus on customer success who can present effectively even under adverse conditions
Strong presentation and communication skills
Next Steps
Our recruitment process is highly personalized. Some candidates complete the hiring process in one week, others may take longer as it’s important we find the right position for you. It's all about timing and can be a journey as we continue to learn about one another. We want to get to know you and encourage you to be selective - after all, deciding to join a company is a big decision
At Atrium, we believe a diverse workforce allows us to match our growth ambitions and drive inclusion across the business. We are an equal opportunity employer and all qualified applicants will receive consideration for employment.

  • Lead data engineer

    4 weeks ago

    Delhi, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Data Engineering Lead

    3 weeks ago

    Delhi, India Welspun Transformation Services Limited Full time

    As a Data Engineering Lead, you will be responsible for managing and leading the data engineering team in our IT department. You will play a crucial role in designing, building, and maintaining our data infrastructure, data processing systems, and data pipelines. You will also be responsible for implementing data visualization tools and techniques to help...

  • Java software engineer

    3 weeks ago

    Delhi, India Lead Masters AI Full time

    Company DescriptionLead Masters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. Lead...

  • Lead Data Engineer

    4 weeks ago

    delhi, India SourceBae Full time

    Lead Data Engineer-MS Fabric.Exp: 10+ yearscontract(remote)shift Time-3PM to 12AM ISTDescriptionWe are looking for a Lead Data Engineer with extensive experience in developing ETL processes using PySpark Notebooks and Microsoft Fabric and supporting existing legacy SQL Server environments. The ideal candidate will possess a strong background in Spark-based...

  • Lead data engineer

    3 weeks ago

    Delhi, India SourceBae Full time

    Lead Data Engineer-MS Fabric.Exp: 10+ yearscontract(remote)shift Time-3 PM to 12 AM ISTDescriptionWe are looking for a Lead Data Engineer with extensive experience in developing ETL processes using Py Spark Notebooks and Microsoft Fabric and supporting existing legacy SQL Server environments. The ideal candidate will possess a strong background in...

  • Java Software Engineer

    3 months ago

    delhi, India Lead Masters AI Full time

    Company Description LeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...

  • Data Platform Engineer

    2 days ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data platform engineer

    2 days ago

    Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Java Software Engineer

    2 months ago

    Delhi, India Lead Masters AI Full time

    Company Description LeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...

  • Data Platform Engineer

    2 days ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Java Software Engineer

    3 months ago

    delhi, India Lead Masters AI Full time

    Company DescriptionLeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...

  • Java Software Engineer

    4 weeks ago

    delhi, India Lead Masters AI Full time

    Company DescriptionLeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...

  • Java Software Engineer

    3 months ago

    Delhi, India Lead Masters AI Full time

    Company DescriptionLeadMasters.ai is an innovative AI-driven platform for lead generation and ad optimization, utilizing advanced algorithms to analyze top-performing ads across social media. The platform empowers businesses of all sizes to maximize their marketing potential through intelligent lead generation and data-driven ad optimization. LeadMasters.ai...

  • AWS Data Engineer

    4 weeks ago

    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    4 months ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    1 month ago

    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Aws data engineer

    4 weeks ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Regional Business Development Lead

    2 weeks ago

    Delhi, Delhi, India LEAD School Full time

    About LEAD SchoolLEAD School is a pioneering education company in India, committed to making high-quality education accessible and affordable for every child. Founded in 2012 by Sumeet Mehta and Smita Deorah, the company has grown rapidly, partnering with over 9,000 private K-12 schools across the country.Our mission is to empower India through excellent...

  • Data Engineering Lead

    1 month ago

    Delhi/Bangalore, India Hero Fincorp Ltd Full time

    Data Engineering LeadWe are seeking an experienced Data Engineering Lead to join our team at Hero Fincorp Ltd. The ideal candidate will have a strong background in data engineering, with expertise in Databricks and AWS. Key responsibilities include designing and developing data pipelines, managing data quality, and leading a team of engineers. A bachelor's...

  • Lead Data Engineer

    1 month ago

    delhi, India Intuitive.Cloud Full time

    About us: Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes. Intuitive Superpowers: - DataOps & AI/ML - Cloud Native, AppSecOps, DevSecOps - Cloud Migration...