Data Engineering Lead

1 day ago

Gandhinagar, India Kanerika Inc Full time

Job Location: Ahmedabad What You Will Do: - Develop and maintain data pipelines using Azure Data Factory (ADF) /Databricks for data integration and ETL processes. - Design, implement, and optimize Power BI /Fabric reports and dashboards to deliver actionable business insights. - Collaborate with data analysts, business users, and other teams to understand data requirements and deliver solutions using ADF and Power BI. - Extract, transform, and load (ETL) data from various sources into cloud-based storage systems such as Azure Data Lake or Azure SQL Database. - Work with large datasets and optimize queries and pipelines for performance and scalability. - Ensure data quality, integrity, and availability throughout the data lifecycle. - Automate repetitive data tasks, ensuring timely and accurate reporting. - Monitor and troubleshoot data pipelines, addressing any performance or data issues promptly. - Support data visualization and reporting tools, including Power BI, to enable business stakeholders to make data-driven decisions. - Write clear, efficient, and maintainable code for data transformations and automation. Required Qualifications: - Bachelor's degree in computer science, Information Technology, Engineering, or a related field. - 8+ years of hands-on experience in Data Engineering, BI Developer or a similar role. - Proficiency with Azure Data Factory (ADF), including the creation of data pipelines and managing data flows. - Strong experience in Power BI, including report creation, dashboard development, and data modeling. - Experience with SQL and database management (e.G., Azure SQL Database, SQL Server). - Knowledge of cloud platforms, especially Microsoft Azure. - Familiarity with data warehousing concepts and ETL processes. - Experience working with cloud-based data storage solutions (e.G., Azure Data Lake, Azure Blob Storage). - Strong programming skills in languages such as Python, SQL, or other relevant languages. - Ability to troubleshoot and optimize data pipelines for performance and reliability. Preferred Qualifications: - Familiarity with data modeling techniques and practices for Power BI. - Knowledge of Azure Databricks or other data processing frameworks. - Knowledge of Microsoft Fabric or other Cloud Platforms. What we need? - B. Tech computer science or equivalent.

  • Lead Data Engineer – Python

    4 weeks ago

    Gandhinagar, India Whatjobs IN C2 Full time

    Job Title: Lead Data Engineer – Python & GCP Location : Hyderabad Exp : 10+ Years Overview: We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP) . You will design, develop, and manage scalable ETL/ELT data pipelines , work closely with clients to understand requirements, and build data solutions...

  • Data Analytics Project Lead

    3 days ago

    Gandhinagar, India beBeeTechnical Full time

    Job Title:Project Manager – Data EngineeringJob Description:We are seeking a skilled Technical Project Manager to lead and deliver projects in data engineering and analytics. Key responsibilities include managing cross-functional teams, executing data platform, pipeline, and analytics initiatives, ensuring alignment with business goals and timely...

  • Data Engineering Leader

    3 days ago

    Gandhinagar, India beBeeDataEngineering Full time

    Job OverviewAchieve success as a data engineering leader by overseeing the design, implementation, and optimization of scalable data pipelines.Lead cross-functional teams to drive innovation in web crawling technologies.Architect robust data systems using modern frameworks and tools.Establish process orchestration using Airflow or Celery.Develop and enforce...

  • Chief Data Engineering Officer

    2 days ago

    Gandhinagar, India beBeeDataLeader Full time

    Data Architect RoleThis role involves designing and implementing scalable data architectures on the cloud, utilizing expertise in CI-CD, Pyspark, SQL, ADF, ADLS & ADB, and Azure Services.The ideal candidate will have experience in a data engineering environment, with 6+ years of experience and a proven track record of success.Main Responsibilities:Designing...

  • Data Engineer Lead

    1 day ago

    Gandhinagar, India beBeeData Full time

    Senior Data ArchitectWe are seeking an experienced professional to join our team as a Senior Data Architect. This role centers on architecting robust data pipelines across on-prem and cloud ecosystems, automating ingestion from varied sources including APIs.Design, Develop, and Optimize ETL/ELT Data PipelinesAutomate Data Ingestion WorkflowsIntegrate...

  • Leading Data Expert

    2 days ago

    Gandhinagar, India beBeeData Full time

    Job OverviewWe are seeking a highly skilled professional to join our advanced analytics team as a Data Analyst. The ideal candidate will design, build, and deploy data-driven solutions leveraging machine learning, deep learning, and cloud-based AI platforms.This role requires hands-on coding capability, strong analytical thinking, and experience...

  • Data Engineer

    5 days ago

    Gandhinagar, India BLJ Tech Geeks Full time

    Job Title: Data Engineer Company - Big4 (PERMANENT) Location: Bangalore (Hybrid) Job Type: Full-time Experience Level: 5Yrs above Notice Period - Serving only till 31st Dec not more than this About the Role: We are looking for a skilled and detail-oriented Data Engineer to join our growing data team. You will be responsible for building and maintaining...

  • Leading Machine Learning Engineer

    4 days ago

    Gandhinagar, India beBeeMachineLearning Full time

    Lead Data ScientistWe are seeking a highly experienced Lead Data Scientist to spearhead our machine learning initiatives in Bangalore.About the Role:Pioneer advanced data-driven solutions and cultivate a culture of innovation within the teamLeverage expertise in machine learning algorithms and collaborate with cross-functional teams to drive business...

  • Lead Data Architect

    1 day ago

    Gandhinagar, India beBeeDataEngineer Full time

    Unlock Career Advancement in Data EngineeringWe are seeking a Senior Data Engineer to join our team and play a crucial role in shaping the future of healthcare analytics.This is an exciting opportunity for candidates based in Europe or India with periodic team gatherings in Mountain View, California.Pipeline Development: Design, build, and maintain scalable...

  • AWS Snowflake Cloud Data Engineer

    3 days ago

    Gandhinagar, India beBeeCloudDataEngineer Full time

    Job Title: Cloud Data Engineering SpecialistThis role is ideal for a seasoned data engineer with expertise in designing, developing, and implementing scalable data solutions using AWS and Snowflake.The successful candidate will lead the design of complex data pipelines, collaborate with cross-functional teams to translate business requirements into technical...