Azure Databricks Engineer

1 month ago


Bangalore, India krtrimaIQ Cognitive Solutions Full time

Job Title: Azure Databricks Engineer

Location: Bangalore

Experience Level: 5+ years of relevant experience

Employment Type: Full-Time

About Us:

Join our team to help shape the future of data solutions We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our clients. If you’re passionate about cloud-based data engineering and enjoy creating impactful solutions, let’s talk

Responsibilities:

  • Data Engineering & Development: Design, develop, and maintain large-scale data processing pipelines on Microsoft Azure, using tools like Azure Data Factory (ADF), Azure Synapse Analytics, and Databricks.
  • Data Modeling & Integration: Implement best practices in data modeling, data integration, and ETL/ELT processes to manage data across structured, semi-structured, and unstructured sources.
  • Database & Storage Solutions: Set up and manage Azure SQL Database, Azure Data Lake, Blob Storage, and ensure optimized data storage solutions for various business requirements.
  • Data Quality & Transformation: Ensure data quality and integrity using advanced transformation and cleansing techniques, and perform regular audits.
  • Collaboration & Documentation: Work closely with data scientists, analysts, and other engineers to understand data needs and ensure smooth, efficient data operations. Document all processes and workflows effectively.
  • Monitoring & Optimization: Monitor system performance and make improvements to maximize data pipeline reliability and efficiency. Optimize resource usage and troubleshoot issues as needed.

Required Skills:

  • Azure Expertise: Strong experience with Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake, Databricks, and Azure SQL Database.
  • ETL & Data Transformation: Proficiency in designing ETL/ELT workflows with experience in data wrangling, cleansing, and transforming large datasets.
  • Programming Skills: Solid understanding of Python or Scala for data processing; SQL proficiency for data manipulation and querying.
  • Data Modeling: Experience in data modeling techniques and best practices for both OLTP and OLAP systems.
  • Big Data Frameworks: Knowledge of Spark or other big data processing frameworks is a plus.
  • Data Quality & Governance: Experience in implementing data quality and data governance practices.

Nice to Have:

  • Power BI: Familiarity with Power BI for data visualization.
  • Machine Learning: Basic understanding of ML models and pipelines on Azure Machine Learning.
  • CI/CD & DevOps: Experience with CI/CD processes on Azure DevOps.

Qualifications:

  • Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • Experience: Minimum of 5+ years in data engineering with a strong focus on Azure services.

What We Offer:

  • Competitive salary and benefits package
  • Opportunity to work on innovative projects in a supportive team environment
  • Continuous learning and professional development opportunities

How to Apply:

If you’re ready to advance your career in Azure data engineering, send your resume to We look forward to connecting with you

Industry

  • IT Services and IT Consulting

Employment Type

Full


  • Azure databricks

    2 weeks ago


    Bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 5-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...

  • Azure Databricks

    4 weeks ago


    Bangalore, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 5-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The...

  • Azure Architect

    2 months ago


    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    Job Title : Azure ArchitectLocation : Bangalore/Bengaluru (Hybrid Mode)Experience : 8 to 12 YearsJob Summary : We are looking for a skilled Azure Architect with extensive experience in data engineering and a strong focus on Azure Databricks. The ideal candidate will have a deep understanding of Azure services, ETL processes, and data warehousing concepts,...

  • Data Engineer

    4 weeks ago


    Bangalore, India upGrad Full time

    Azure Databricks & Snowflake Data Engineer.Location : Pan India.Employment Type : Full-time.Experience : 6 to 12 years.Notice Period : Immediate to 15 days only.Job Description :We are looking for an experienced Kafka Streaming with Azure Databricks & Snowflake Data Engineer to join our growing team.The successful candidate will be responsible for designing,...


  • bangalore, India Tredence Inc. Full time

    MUST HAVE• Minimum of 4 to 8 years of Azure DE experience.• In-depth technical knowledge of tools like Azure Data Factory, Databricks, Azure Synapse, SQL DB, ADLS etc.• Experience in collaborating with business stakeholders to identify and meet data requirements• Experience in using Azure services and tools to ingest, egress, and transform data from...


  • Hyderabad/Bangalore, India Quadrant Technologies Full time

    We are looking for Azure Data Engineers!!. Exp : 4 -7 Years. Location : Hyderabad/Bangalore. Mode : Hybrid. Notice : 10 days. Skills : Mandatory : Pyspark,SQL,DAX,Cube,. Preferred : ADF,ADB,SSIS/SSAS, Fabric. Responsibilities : Data Curation and Transformation : - Translate business requirements into technical solutions for data curation and...


  • bangalore, India Arthya Tech Solutions Full time

    Position Summary: At Arthya Tech we are building Global Competency center - GCC for our client - an US based producer of dairy products. As a Senior Developer, you will be responsible for technical leadership of Agile Team(s) with our Business Analytics & Insights (BAI) team. You will work closely with cross-functional teams to deliver high-quality...

  • Senior developer

    2 weeks ago


    Bangalore, India Arthya Tech Solutions Full time

    Position Summary:   At Arthya Tech we are building Global Competency center - GCC for our client - an US based producer of dairy products.  As a Senior Developer, you will be responsible for technical leadership of Agile Team(s) with our Business Analytics & Insights (BAI) team. You will work closely with cross-functional teams to deliver high-quality...

  • Azure Databricks

    1 month ago


    Bangalore, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has proudly created an exceptional leadership community with leaders like you to drive change, foster innovation and retain TCS as the top player in the business market. As a Technical Professional you will provide expertise in specific technology / methodology / business / application / product in terms of technical / solution...

  • Azure Data Engineer

    2 months ago


    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking an experienced Azure Data Engineer to join our team. Job Title : Azure Data EngineerLocation : : 3+ Years The ideal candidate will have 3+ years of hands-on experience in Azure data services, including Azure Databricks, Azure Data Factory, Azure SQL, and Azure Data Lake. You will be responsible for designing, developing, and maintaining...


  • bangalore, India Arthya Tech Solutions Full time

    Position Summary:At Arthya Tech we are building Global Competency center - GCC for our client - an US based producer of dairy products.As a Senior Developer, you will be responsible for technical leadership of Agile Team(s) with our Business Analytics & Insights (BAI) team. You will work closely with cross-functional teams to deliver high-quality solutions...


  • bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-BangaloreJD-Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features.Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposureAbility to gather requirements...


  • Bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-Bangalore JD- Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features. Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposure Ability to gather...


  • Bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10 Yrs-Bangalore JD- Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure Paa S features. Azure Cloud , Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposure Ability to gather...


  • bangalore, India Tata Consultancy Services Full time

    We are looking for Azure Data Engineer (Databricks) Azure Data Engineer (Databricks) Experience Range- 4 to 10years. Location: Hyderabad, Kolkata, Noida, Chennai, Bangalore Mode of Interview: Online Interview Interview Date: 6th Dec 24 (Friday) Interview Time: 10 am to 5pm Must Have: In depth coding knowledge in Python, SQL and SPARK. Must know how to...


  • bangalore, India Tata Consultancy Services Full time

    We are looking for Azure Data Engineer (Databricks)Azure Data Engineer (Databricks)Experience Range- 4 to 10years.Location: Hyderabad, Kolkata, Noida, Chennai, BangaloreMode of Interview: Online InterviewInterview Date: 6th Dec 24 (Friday)Interview Time: 10 am to 5pmMust Have:In depth coding knowledge in Python, SQL and SPARK. Must know how to use Databricks...


  • Bangalore, India Brillio Technologies Pvt. Ltd Full time

    Role : ML Engineer (Databricks + PySpark) Locations : BangaloreMandate Skill sets : Azure, Pyspark on Databricks, ADF / Azure Devops.About the role :We are looking for Machine Learning Engineers who will work on a broad range of cutting-edge data analytics and machine learning problems across a variety of industries. More specifically, you will engage with...


  • bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-Bangalore JD- Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features. Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposure Ability to gather...


  • bangalore, India Tata Consultancy Services Full time

    Azure Databricks-7to10Yrs-BangaloreJD-Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure SQL DW, , Azure Data Lake Store , Azure Data Factory and understanding of Microsoft Azure PaaS features.Azure Cloud ,Azure Databricks, Data Factory knowledge are good to have, otherwise any cloud exposureAbility to gather requirements...

  • Data Engineer

    3 weeks ago


    Bangalore, India Allime Tech Solutions Full time

    Role : Data Engineer. Experience : 6 to 8Yrs. Location : Bangalore. Notice Period : Immediate Joiner. Skill : - Design, build, and maintain data pipelines using Azure Data Factory, Databricks, Snowflake, and PySpark. - Develop and implement data transformation and cleansing techniques to ensure data quality and reliability. - Collaborate with...