Lead Data Engineer

6 days ago

Ahmedabad, Gujarat, India DnT Infotech Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Roles & Responsibilities:

  • Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights.
  • Constructing infrastructure (on cloud - GCP) for efficient ETL processes from various sources and storage systems.
  • Creating innovative data validation methods and data analysis tools.
  • Ensuring compliance with data governance and security policies.
  • Conducting complex data analysis and presenting results effectively.
  • Continuously exploring opportunities to enhance data quality and reliability.
  • Data Modeling:

oCreate and maintain data models that support business requirements and data analytics.

oEnsure data structures are optimized for performance and scalability.

  • Collaboration:

oWork closely with cross-functional teams, including data scientists, analysts, and business users, to understand data needs and provide effective solutions.

oCollaborate with IT Infra team and security teams to ensure infra-availability, data privacy and compliance with security standards.

  • Technology Knowledge:

oETL: Extract, Transform and Load:

oDevelop, optimize, and maintain ETL processes to extract, transform, and load data from diverse sources into the Data Lake.

oImplement data quality checks and ensure the reliability and accuracy of the end-to-end data flow pipelines from the data sources through ETL to GCP storage to Data Lakehouse layer to Qliksense.

oTalend knowledge is a minimum.

oDatalake:

oDesign, implement, and maintain our Data Lake architecture to ensure efficient storage, retrieval, and processing of large volumes of structured and unstructured data.

Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.

oDremio or Google BigQuery knowledge would be an added advantage.

oBI Integration:

oIntegrate Business Intelligence tools with the Data Lake to provide stakeholders with meaningful insights and reports.

oCollaborate with analysts and business users to understand reporting requirements and implement dashboards and visualizations.

oQlikSense or Tableau knowledge would be an added advantage.

Qualification and Skills:

  • Bachelors degree in computer science, Information Systems, Data Science, or a related field.
  • Minimum 6 to 7 years of experience in data engineering space
  • Proficient in SQL to perform data querying and manipulation.
  • Experience with data integration and ETL processes to extract, transform, and load data from various sources.
  • Excellent verbal and written communication skills to effectively convey insights and findings to internal and external stakeholders.
  • Strong problem-solving skills and the ability to find innovative solutions to business challenges through data visualization.
  • Collaborative mindset with the ability to work effectively in a team-oriented environment.
  • Strong analytical and critical-thinking skills to interpret data and draw meaningful conclusions.

  • Systems - Senior Software Engineer/Technical Lead -

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionWe are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad.The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location :PUNE / AHMEDABAD (WFO Only).Key ResponsibilitiesResponsible for providing expertise in...

  • Senior Software Engineer/Technical Lead

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Systems Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments. Location : PUNE / AHMEDABAD (WFO Only). Key Responsibilities : -...

  • Lead Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Tecblic Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description:Lead Data Engineer with Azure CloudLocation:AhmedabadExperience:6 to 7 yearsEmployment Type:Full-TimeWe are looking for a highly motivated and experienced Data Engineer to join our  team. As a Data Engineer, you will play a critical role in designing, building, and optimizing data pipelines that ensure the availability, reliability, and...

  • Lead Data Engineer

    5 days ago

    Ahmedabad, Gujarat, India ProClink Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Core Responsibilities:Lead end-to-end design, development, and delivery of complex cloud-based data pipelines.Collaborate with architects and stakeholders to translate business requirements into technical data solutions.Ensure scalability, reliability, and performance of data systems across environments.Provide mentorship and technical leadership to data...

  • Lead - Data Engineering

    1 week ago

    Ahmedabad, Gujarat, India Tatvic ® Full time ₹ 18,00,000 - ₹ 25,00,000 per year

    Company DescriptionTatvic, is a marketing analytics company focusing on generating insights from data using long association with Google & its infrastructure. We breed,recognize and reward performance. As a company we are growing very fast & we are under transformation. To enable this transformation we need future leaders with eyesight which balances...

  • Lead Data Engineer

    5 days ago

    Ahmedabad, Gujarat, India Advantmed Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    We are seeking a talented and experienced Lead Data Engineer to join our team and contribute to building a robust data platform on Azure Cloud. The ideal candidate will have hands-on experience designing and managing data pipelines, ensuring data quality, and leveraging cloud technologies for scalable and efficient data processing. The Data Engineer will...

  • Senior DevOps Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: Job Location- AhmedabadJob DescriptionWe...

  • Lead Data Scientist

    5 days ago

    Ahmedabad, Gujarat, India eInfochips (An Arrow Company) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Lead AI/ML EngineerLocation: Ahmedabad, Pune, IndoreYears of Experience: 8 to 12 yearsNotice Period – 0-45 Days MaxWe are looking for a highly skilled and experienced Lead AI/ML Engineer to lead the development and deployment of machine learning solutions across the organization. The ideal candidate will possess deep technical expertise in ML...

  • Lead Data Engineer/Sr. Data Engineer

    5 days ago

    Ahmedabad, Gujarat, India Innovatics Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description:5+ years of experience in a Data Engineer role,Experience with object-oriented/object function scripting languages: Python, Scala, Golang, Java, etc.Experience with Big data tools such as Spark, Hadoop/ Kafka/ Airflow/HiveExperience with Streaming data: Spark/Kinesis/Kafka/Pubsub/Event HubExperience with GCP/Azure data factory/AWSStrong in...

  • Lead – Data Architect

    1 week ago

    Ahmedabad, Gujarat, India Adani Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    ResponsibilitiesLead the design and implementation of data architecture and data modeling solutions for airport operations, ensuring scalability, performance, and reliability.Collaborate with cross-functional teams to gather and understand data requirements and translate them into effective database designs and data management strategies.Proven experience in...