Data Engineer Role

3 days ago

Gulbarga, Karnataka, India beBeeDataArchitect Full time ₹ 18,00,000 - ₹ 24,00,000
Senior Data Architect Position

We are seeking a highly skilled Senior Data Architect to join our team. The ideal candidate will have expertise in designing and implementing scalable data architectures, developing and optimizing ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.

This role involves performing data ingestion, transformation, and orchestration across structured and unstructured datasets. The successful candidate will develop and maintain data lake solutions in Azure Data Lake Storage (ADLS) Gen2, write and optimize SQL queries for data extraction, transformation, and analysis.

The Senior Data Architect will implement CI/CD pipelines for data workflows using Azure DevOps, collaborate with stakeholders to understand data requirements, and ensure data availability. Ensuring data governance, security, and compliance in Azure-based data solutions is also crucial.

  • Key Responsibilities:
  • Design and implement scalable data architectures following Medallion Architecture and best practices.
  • Develop and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics.
  • Perform data ingestion, transformation, and orchestration across structured and unstructured datasets.
  • Develop and maintain data lake solutions in Azure Data Lake Storage (ADLS) Gen2.
  • Write and optimize SQL queries for data extraction, transformation, and analysis.
  • Implement CI/CD pipelines for data workflows using Azure DevOps.
  • Collaborate with stakeholders to understand data requirements and ensure data availability.
  • Ensure data governance, security, and compliance in Azure-based data solutions.
  • Monitor and troubleshoot data pipelines to maintain reliability and performance.
  • Stay updated with the latest Azure and big data technologies and implement best practices.
Required Skills and Qualifications

To be successful in this role, you will need:

  • Mandatory Skills:
  • Strong experience in Azure Data Engineering with Data Factory, Synapse, Fabric, Databricks.
  • Expertise in SQL, T-SQL, and Python for data processing and transformation.
  • Hands-on experience with PySpark for big data processing.
  • Experience in designing ETL/ELT pipelines and working with large datasets.
  • Proficiency with Azure Data Lake (ADLS) Gen2 for data storage and processing.
  • CI/CD and DevOps knowledge, including Azure DevOps, Git, and automated deployments.
  • Understanding of data modeling, data warehousing, and schema design principles.
What We Offer

At Damco, we offer a dynamic work environment that promotes growth and innovation. You will have opportunities to work on challenging projects, collaborate with experienced professionals, and develop your skills in cutting-edge technologies.

If you are a motivated individual who is passionate about data architecture and engineering, please submit your application. We look forward to hearing from you.

  • Key Data Engineer Role

    5 days ago

    Gulbarga, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Description:A Data Engineer with expertise in Informatica DEI will be responsible for designing, developing, and maintaining large-scale data engineering solutions.Required Skills and Qualifications:We are looking for individuals with the following skills and qualifications:Strong hands-on experience in Informatica DEI (Data Engineering Integration)Basic...

  • Data Engineer

    4 weeks ago

    Gulbarga, Karnataka, India BL Consultants Full time

    We're Hiring | Data EngineersLooking for an exciting role where you can build, scale, and innovate?We're hiring for one of our clients and are on the lookout for Data Engineers (1–3 yrs) and Sr. / Lead Data Engineers (3–9 yrs) with strong hands-on experience in: Databricks | SQL | PySpark | Python Strong knowledge of Spark, Delta Lake, and Data Lakehouse...

  • Cloud Data Engineer

    4 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data Engineering SpecialistWe are seeking an experienced Cloud Data Engineering Specialist to design, implement and maintain large-scale data processing pipelines.Main Responsibilities:Designing, implementing and maintaining data processing pipelines using Azure Data Factory (ADF), Azure Databricks (ADB), PySpark and SQL.Collaborating with...

  • Data Scientist Role

    3 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Opportunity:We are seeking a skilled professional to fill the role of Data Analyst.The ideal candidate will have a strong background in statistical analysis, machine learning, and data visualization. They will work with large and complex data sets to develop insights and make informed decisions that drive business growth.Key Responsibilities...

  • Databricks Data Engineer

    5 days ago

    Gulbarga, Karnataka, India beBeeDataEngineering Full time ₹ 18,14,400 - ₹ 25,12,000

    Databricks Data EngineerKey Responsibilities:Design, develop, and maintain scalable data pipelines on Databricks.Lead the architecture and implementation of high-performance data solutions using Databricks.Collaborate with business stakeholders and data scientists to deliver actionable data insights.Optimize data workflows for performance, cost-efficiency,...

  • Chief Data Engineer

    3 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Data Engineer PositionWe are seeking a seasoned data engineer with expertise in designing, implementing, and optimizing large-scale data pipelines.The ideal candidate will have experience working with cloud platforms, such as AWS, Azure, or Google Cloud, and be proficient in Python for data engineering tasks.They will also possess strong knowledge of...

  • Data Engineering Expert

    7 days ago

    Gulbarga, Karnataka, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Data Engineer to lead our data systems.This role involves collaborating with cross-functional teams to design, develop, and maintain large-scale data platforms. Key responsibilities include:Data System Design: Work closely with stakeholders to create robust data models that meet business requirements.System Development:...

  • Senior Data Engineer

    3 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    As a seasoned data professional, you will be responsible for developing and maintaining large-scale data pipelines using Python and AWS.About the RoleThis position involves designing and implementing efficient data solutions to drive business growth through data analysis and interpretation.You will collaborate with cross-functional teams to ensure data...

  • Data Platform Engineer

    3 days ago

    Gulbarga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a seasoned Data Architect to spearhead the development of our data engineering solutions.Design and develop robust, scalable, and secure data architectures that meet business requirements.Lead the implementation of data solutions on various cloud platforms (AWS, Azure, and GCP).Define and enforce data governance, quality, and...

  • Senior Data Engineering Specialist

    4 days ago

    Gulbarga, Karnataka, India beBeeDataEngineering Full time US$ 60,000 - US$ 80,000

    Senior Data Engineering SpecialistWe are seeking a seasoned Senior Data Engineering Specialist to join our global engineering team.This key role will involve leveraging expertise in data engineering on a greenfield multi-year project initiative, utilizing strong experience with Palantir Foundry, Workshop, PySpark, and Typescript.Palantir Foundry / Workshop:...