Lead Data Engineer

3 weeks ago

Ahmedabad, Gujarat, India Arting Digital Full time

Posting title : Lead Data Engineer (Databricks)

Experience : 7+ Years

Location : Pune/ Ahmedabad

Work mode : Hybrid

Primary skills : Databricks, Data Modelling/ Data Lakehouse, Gen AI, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue, Docker, Team Lead

Qualification : Any Technical Degree

Roles & Responsibilities :

- Lead the design, development, and optimization of data solutions using Databricks, ensuring they are scalable, efficient, and secure.

- Collaborate with cross-functional teams to gather and analyse data requirements, translating them into robust data architectures and solutions.

- Develop and maintain ETL pipelines, leveraging Databricks and integrating with Azure Data Factory as needed.

- Implement machine learning models and advanced analytics solutions, incorporating Generative AI to drive innovation.

- Ensure data quality, governance, and security practices are adhered to, maintaining the integrity and reliability of data solutions.

- Provide technical leadership and mentorship to junior engineers, fostering an environment of learning and growth.

- Stay updated on the latest trends and advancements in data engineering, Databricks, Generative AI, and Azure Data Factory to continually enhance team Qualifications :

- Bachelors or masters degree in computer science, Information Technology, or a related field.

- 7+ to 10 years of experience in data engineering, with a focus on Databricks.

- Proven expertise in building and optimizing data solutions using Databricks and integrating with Azure Data Factory/AWS Glue.

- Proficiency in SQL and programming languages such as Python or Scala.

- Strong understanding of data modelling, ETL processes, and Data Warehousing/Data Lakehouse concepts.

- Familiarity with cloud platforms, particularly Azure, and containerization technologies such as Docker.

- Excellent analytical, problem-solving, and communication skills.

- Demonstrated leadership ability with experience mentoring and guiding junior team members.

Preferred Skills :

- Experience with Generative AI technologies and their applications.

- Familiarity with other cloud platforms, such as AWS or GCP.

- Knowledge of data governance frameworks and tools.

(ref:hirist.tech)

  • Lead Engineer

    4 weeks ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Role : ReactJS Lead EngineerWe are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data Responsibilities :- Responsible for providing expertise in software development life...

  • Anblicks - Lead Data Engineer - Snowflake Migration

    4 weeks ago

    Ahmedabad, Gujarat, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Job Title : Lead Data Engineer Snowflake MigrationLocation : Hyderabad / AhmedabadExperience : 7+ YearsBe a Trailblazer in Our Data Modernization Center of Excellence (COE)At Anblicks, we are on a mission to modernize legacy data ecosystems and help enterprises unlock the power of the cloud. Our Data Modernization COE is at the forefront of this...

  • Lead Data Engineer

    4 days ago

    Ahmedabad, Gujarat, India Circle K Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionAlimentation Couche-Tard Inc., (ACT) is a global Fortune 200 company. A leader in the convenience store and fuel space with over 16,700 stores in 31 countries, serving more than 9 million customers each day. At Circle K, we are building a best-in-class global data engineering practice to support intelligent business decision-making and drive...

  • Senior Software Engineer/Technical Lead

    4 weeks ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Company Overview :Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics.The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior Software Engineer/Technical Lead

    3 weeks ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time

    Company Overview :Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics.The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Lead Data Engineer

    3 weeks ago

    Ahmedabad, Gujarat, India Inferenz Full time

    About the CompanyWe are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions.This role involves working on complex datasets, building robust data pipelines, ensuring data quality, and collaborating closely with analytics and business teams to deliver actionable...

  • Lead Data Engineer

    6 days ago

    Ahmedabad, Gujarat, India Inferenz Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the CompanyWe are seeking a Lead Data Engineer with deep expertise in Snowflake, dbt, and Apache Airflow to design, implement, and optimize scalable data solutions. This role involves working on complex datasets, building robust data pipelines, ensuring data quality, and collaborating closely with analytics and business teams to deliver actionable...

  • Lead Data Engineer

    4 days ago

    Ahmedabad, Gujarat, India Advantmed Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are seeking a talented and experienced Lead Data Engineer to join our team and contribute to building a robust data platform on Azure Cloud. The ideal candidate will have hands-on experience designing and managing data pipelines, ensuring data quality, and leveraging cloud technologies for scalable and efficient data processing. The Data Engineer will...

  • Data Architecture and Engineering Lead

    4 days ago

    Ahmedabad, Gujarat, India Tecblic Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Data Architecture & Engineering LeadIndustry Type:IT Services & ConsultingEmployment Type:Full Time,Permanent RoleSkills-Drive Azure-based data solutions, modeling, warehousing & AI/ML pipelines, Azure, Databricks, Spark, Kafka, SAP/MS Dynamics.

  • Senior Administration Executive

    4 days ago

    Ahmedabad, Gujarat, India Technobeat Engineer Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    We are seeking a dedicated Senior Admin Executive. The role is to manage and preparation of reports, ensure accuracy, and maintain monthly documentation. Responsible for collecting data from engineers, guiding team in report creation, and submission.