Data Engineering Lead

1 month ago

Rajkot, India Atrium Full time

Unlock yourself. Take your career to the next level.

At Atrium, we live and deliver at the intersection of industry strategy, intelligent platforms, and data science — empowering our customers to maximize the power of their data to solve their most complex challenges. We have a unique understanding of the role data plays in the world today and serve as market leaders in intelligent solutions. Our data-driven, industry-specific approach to business transformation for our customers places us uniquely in the market.


Who are you?

You are smart, collaborative and take ownership to get things done. You love to learn and are intellectually curious in business and technology tools, platforms and languages. You are energized by solving complex problems and bored when you don’t have something to do. You love working in teams, and are passionate about pulling your weight to make sure the team succeeds.


What will you be doing at Atrium?

In this role, you will join the best and brightest in the industry to skillfully push the boundaries of what’s possible. You will work with customers to make smarter decisions through innovative problem-solving using data engineering, Analytics, and systems of intelligence. You will partner to advise, implement, and optimize solutions through industry expertise, leading cloud platforms, and data engineering.

As a Lead Data Engineering Consultant, you will be responsible for expanding and optimizing the data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. You will support the software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.


In this role, you will:

  • Create and maintain optimal data pipeline architecture
  • Assemble large, complex data sets that meet functional / non-functional business requirements
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, DBT, Python, AWS, and Big Data tools
  • Development of ELT processes to ensure timely delivery of required data for customers
  • Implementation of Data Quality measures to ensure accuracy, consistency, and integrity of data
  • Design, implement, and maintain data models that can support the organization's data storage and analysis needs
  • Deliver technical and functional specifications to support data governance and knowledge sharing


In this role, you will have:

  • Bachelor’s degree in Computer Science, Software Engineering, or equivalent combination of relevant work experience and education
  • 4-8 years of experience delivering consulting services to medium and large enterprises. Implementations must have included a combination of the following experiences:
  • Data Warehousing or Big Data consulting for mid-to-large-sized organizations.
  • Strong analytical skills with a thorough understanding of how to interpret customer business needs and translate those into a data architecture
  • Strong experience with Snowflake and Data Warehouse architecture preferred
  • SnowPro Core certification is highly desired
  • Hands-on experience with Python (Pandas, Dataframes, Functions)
  • Hands-on experience with SQL (Stored Procedures, functions) including debugging, performance optimization, and database design
  • Hands-on experience with Snowflake data loads
  • Experience with data analysis and data processing using Python & Snowflake
  • Experience with creating User defined functions using Snowflake SnowSQL
  • Experience with SQL optimization, workload management using Snowflake
  • Strong Experience with Apache Airflow and API integrations
  • Experience with leading and mentoring junior data engineers
  • Solid experience in any one of the ETL/ELT tools (DBT, Mulesoft, FiveTran, AirFlow, AirByte, Matillion, Talend, Informatica, SAP BODS, DataStage, Dell Boomi, Mulesoft, FiveTran, Matillion, etc.)
  • Nice to have: Experience in Docker, DBT, data replication tools (SLT, HVR, Qlik, etc), Shell Scripting, Linux commands, AWS S3, or Big data technologies
  • Strong project management, problem-solving, and troubleshooting skills with the ability to exercise mature judgment
  • Enthusiastic, professional, and confident team player with a strong focus on customer success who can present effectively even under adverse conditions
  • Strong presentation and communication skills


Next Steps

Our recruitment process is highly personalized. Some candidates complete the hiring process in one week, others may take longer as it’s important we find the right position for you. It's all about timing and can be a journey as we continue to learn about one another. We want to get to know you and encourage you to be selective - after all, deciding to join a company is a big decision

At Atrium, we believe a diverse workforce allows us to match our growth ambitions and drive inclusion across the business. We are an equal opportunity employer and all qualified applicants will receive consideration for employment.

  • Data Engineer

    4 weeks ago

    Rajkot, India NCR Voyix Full time

    Position Summary & Key Areas of ResponsibilityWe are looking for a passionate professional who can blend the fast-changing technology landscape of Cloud based Big Data & Advanced Analytics with the complex and high-impact space of IoT Analytics. The Senior Big Data Engineer is responsible for partnering with business unit leaders within NCR Voyix to analyze,...

  • Senior Software Engineer

    1 month ago

    Rajkot, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: Location - AhmedabadKey Responsibilities...

  • Lead Data Governance Expert

    4 weeks ago

    Rajkot, Gujarat, India InCommon Full time

    Job Title: Lead Data Governance ExpertEstimated Salary: $120,000 - $180,000 per annumAbout the RoleWe are seeking a highly skilled and experienced Lead Data Governance Expert to join our team at InCommon. As a key member of our Data Management group, you will be responsible for driving complex data management thought leadership and implementing best...

  • G M ENGINEERING PVT LTD | Inside Sales Manager

    2 weeks ago

    rajkot, India G M ENGINEERING PVT LTD Full time

    Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.!We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity.Company DescriptionG M...

  • G m engineering pvt ltd | inside sales manager

    2 weeks ago

    Rajkot, India G M ENGINEERING PVT LTD Full time

    Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.!We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity.Company DescriptionG M...

  • Data Analytics Engineer

    2 weeks ago

    Rajkot, India True Tech Professionals Full time

    ● Overall 7+ Years and 4+ years of experience in data engineering and analytics.● Strong experience with cloud data solutions (AWS preferred), ETL processes, and Big Data tools.● Hands-on experience with data storage systems such as S3, MinIO, and Snowflake.● Familiarity with Kafka for real-time data streaming and Airflow for scheduling and...

  • Manager - Data Engineering

    1 day ago

    Rajkot, India Core Minds Tech SOlutions Full time

    Job Description :In this role, you will :- Manage and develop team of data analysts with low to moderate complexity and risk in data management and technology, and engage stakeholders and internal partners- Identify and recommend opportunities for process improvement and risk control development- Operate data environments, integrate with new technologies and...

  • Atyeti Inc | Lead Bigdata Developer/ Bigdata Engineer/ Lead Data Engineer | rajkot

    1 month ago

    rajkot, India Atyeti Inc Full time

    Job Description:Analyze, organize and process raw data using Bigdata technologies and Scala/ JavaPerform data validation, cleaning and transformation using big data technologies, Spark and ScalaIngest and manage data in HDFS/Hive and analyse data using Spark and produce meaningful insights for the business team.6+ years of high-tech industry and/or IT work...

  • G M ENGINEERING PVT LTD | Inside Sales Manager

    2 weeks ago

    Rajkot, India G M ENGINEERING PVT LTD Full time

    Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.!We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity.Company DescriptionG M...

  • G M ENGINEERING PVT LTD | Inside Sales Manager

    2 weeks ago

    rajkot, India G M ENGINEERING PVT LTD Full time

    🌟 Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.! 🌟We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity.Company...

  • GCP Data Engineer

    2 months ago

    Rajkot, India Quantiphi Full time

    Designation: Data EngineerExperience Level: 4-16 YearsLocation: Mumbai/Bangalore/TrivandrumRole & Responsibilities:In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Dataflow / GCS/ BigTableMust have proficient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDBSolid understanding of...

  • DSM EDM ENGINEERING PRODUCTS | Sales Executive

    4 days ago

    rajkot, India DSM EDM ENGINEERING PRODUCTS Full time

    Company: DSM EDM Engineering ProductsLocation: Shed 12/2, Swastik Industrial Area,                Opp. Satyam Chemicals, Rajkot Gondal                highway,Shpar, Rajkot-360024                GujaratJob Type: Full-timeSummaryDSM EDM Engineering Products is a leading provider of all types of CNC Wire Cut EDM...

  • Human Resource Manager

    2 weeks ago

    Rajkot, Gujarat, India Aquamech Engineering Corporation Full time

    Job DescriptionAquamech Engineering Corporation is seeking a highly skilled Human Resource Manager to oversee our HR functions.About the RoleThis is a full-time position that reports directly to the Management Team. The successful candidate will be responsible for overseeing personnel records, updating company databases, creating and circulating documents,...

  • Inside Sales Manager

    2 weeks ago

    Rajkot, India G M ENGINEERING PVT LTD Full time

    Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.!We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity.Company DescriptionG M...

  • Inside Sales Manager

    2 weeks ago

    Rajkot, India G M ENGINEERING PVT LTD Full time

    Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.! We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity.Company DescriptionG...

  • Inside Sales Manager

    2 weeks ago

    Rajkot, India G M ENGINEERING PVT LTD Full time

    Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.! We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity. Company...

  • Inside Sales Manager

    2 weeks ago

    Rajkot, India G M ENGINEERING PVT LTD Full time

    Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.! We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity. Company...

  • Data Storage Quality Assurance Engineer

    2 weeks ago

    Rajkot, Gujarat, India DoublU Full time

    We are looking for an experienced Data Storage Quality Assurance Engineer to join our team at DoublU. As a key member of our quality assurance group, you will be responsible for ensuring the highest quality of our data storage solutions.With 5-10 years of testing experience and a strong background in computer science or engineering, you will play a crucial...

  • Inside Sales Manager

    2 weeks ago

    Rajkot, India G M ENGINEERING PVT LTD Full time

    🌟 Join Our Team as Inside Sales Manager at G M Engineering Pvt. Ltd.! 🌟We are on the lookout for a dynamic Inside Sales Manager to lead and optimize our sales operations from our headquarters in Rajkot, India. This is an exciting full-time, on-site role within the ever-evolving industrial valve sector, where innovation meets opportunity.Company...

  • Lead Front-end Engineer

    4 weeks ago

    Rajkot, Gujarat, India Vispan Solutions Pvt. Ltd. Full time

    At Vispan Solutions Pvt. Ltd., we are seeking a highly skilled Lead Front-end Engineer to join our team.Job SummaryWe are looking for an experienced and talented front-end developer who can lead our front-end development efforts, drive innovation, and deliver high-quality solutions on time.Key ResponsibilitiesLeverage expertise in front-end design and...