Azure Databricks Engineer

2 weeks ago

Bengaluru, India krtrimaIQ Cognitive Solutions Full time

Job Title: Azure Databricks Engineer

Location: Bangalore

Experience Level: 5+ years of relevant experience

Employment Type: Full-Time

About Us:

Join our team to help shape the future of data solutions We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our clients. If you’re passionate about cloud-based data engineering and enjoy creating impactful solutions, let’s talk

Responsibilities:

  • Data Engineering & Development: Design, develop, and maintain large-scale data processing pipelines on Microsoft Azure, using tools like Azure Data Factory (ADF), Azure Synapse Analytics, and Databricks.
  • Data Modeling & Integration: Implement best practices in data modeling, data integration, and ETL/ELT processes to manage data across structured, semi-structured, and unstructured sources.
  • Database & Storage Solutions: Set up and manage Azure SQL Database, Azure Data Lake, Blob Storage, and ensure optimized data storage solutions for various business requirements.
  • Data Quality & Transformation: Ensure data quality and integrity using advanced transformation and cleansing techniques, and perform regular audits.
  • Collaboration & Documentation: Work closely with data scientists, analysts, and other engineers to understand data needs and ensure smooth, efficient data operations. Document all processes and workflows effectively.
  • Monitoring & Optimization: Monitor system performance and make improvements to maximize data pipeline reliability and efficiency. Optimize resource usage and troubleshoot issues as needed.

Required Skills:

  • Azure Expertise: Strong experience with Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake, Databricks, and Azure SQL Database.
  • ETL & Data Transformation: Proficiency in designing ETL/ELT workflows with experience in data wrangling, cleansing, and transforming large datasets.
  • Programming Skills: Solid understanding of Python or Scala for data processing; SQL proficiency for data manipulation and querying.
  • Data Modeling: Experience in data modeling techniques and best practices for both OLTP and OLAP systems.
  • Big Data Frameworks: Knowledge of Spark or other big data processing frameworks is a plus.
  • Data Quality & Governance: Experience in implementing data quality and data governance practices.

Nice to Have:

  • Power BI: Familiarity with Power BI for data visualization.
  • Machine Learning: Basic understanding of ML models and pipelines on Azure Machine Learning.
  • CI/CD & DevOps: Experience with CI/CD processes on Azure DevOps.

Qualifications:

  • Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • Experience: Minimum of 5+ years in data engineering with a strong focus on Azure services.

What We Offer:

  • Competitive salary and benefits package
  • Opportunity to work on innovative projects in a supportive team environment
  • Continuous learning and professional development opportunities

How to Apply:

If you’re ready to advance your career in Azure data engineering, send your resume to nikhil.kumar@krtrimaiq.ai. We look forward to connecting with you


Industry

  • IT Services and IT Consulting


Employment Type

Full

  • Azure data engineer

    2 days ago

    Bengaluru, India Tata Consultancy Services Full time

    We are looking for Azure Data Engineer (Databricks)Azure Data Engineer (Databricks)Experience Range- 4 to 10years.Location: Hyderabad, Kolkata, Noida, Chennai, BangaloreMode of Interview: Online InterviewInterview Date: 6th Dec 24 (Friday)Interview Time: 10 am to 5pmMust Have:In depth coding knowledge in Python, SQL and SPARK.Must know how to use Databricks...

  • Azure Databricks Engineer

    2 months ago

    Bengaluru, India Bosch Full time

    Job Description The Azure Databricks Data Engineer will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks. You will be responsible for developing and managing data pipelines, ensuring data quality, and enabling advanced analytics capabilities by building standardized Data Models. Your role will involve close...

  • Azure Databricks Engineer

    3 months ago

    Bengaluru, India Mazenet solution Full time

    Company OverviewMazenet solution is a prominent player in the IT service industry with a workforce of 201-500 employees. Our company, headquartered in Chennai, provides innovative solutions in various IT domains. With a strong presence in the market, Mazenet solution is dedicated to delivering high-quality services and fostering a positive workplace for our...

  • Azure databricks engineer

    2 weeks ago

    Bengaluru, India KrtrimaIQ Cognitive Solutions Full time

    Job Title: Azure Databricks EngineerLocation: BangaloreExperience Level: 5+ years of relevant experienceEmployment Type: Full-TimeAbout Us:Join our team to help shape the future of data solutions! We are looking for a skilled Azure Data Engineer to work on cutting-edge projects, transforming large-scale data and enabling data-driven insights for our...

  • Azure Databricks

    2 months ago

    Bengaluru, India Ahvi Infotech Full time

    About the job Azure DatabricksPosition: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouseSecondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadEssential experience:Experience in building ETL / data warehouse transformation processes Direct...

  • Azure Databricks

    5 days ago

    Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 5-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Azure Data Engineer

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    We are looking for Azure Data Engineer (Databricks) Azure Data Engineer (Databricks) Experience Range- 4 to 10years. Location: Hyderabad, Kolkata, Noida, Chennai, Bangalore Mode of Interview: Online Interview Interview Date: 6th Dec 24 (Friday) Interview Time: 10 am to 5pm Must Have: In depth coding knowledge in Python, SQL and SPARK. Must know how...

  • Azure Data Engineer

    4 days ago

    Bengaluru, India Tata Consultancy Services Full time

    We are looking for Azure Data Engineer (Databricks)Azure Data Engineer (Databricks)Experience Range- 4 to 10years.Location: Hyderabad, Kolkata, Noida, Chennai, BangaloreMode of Interview: Online InterviewInterview Date: 6th Dec 24 (Friday)Interview Time: 10 am to 5pmMust Have:In depth coding knowledge in Python, SQL and SPARK. Must know how to use Databricks...

  • Azure Data Engineer

    19 hours ago

    Bengaluru, India Tata Consultancy Services Full time

    We are looking for Azure Data Engineer (Databricks)Azure Data Engineer (Databricks)Experience Range- 4 to 10years.Location: Hyderabad, Kolkata, Noida, Chennai, BangaloreMode of Interview: Online InterviewInterview Date: 6th Dec 24 (Friday)Interview Time: 10 am to 5pmMust Have:In depth coding knowledge in Python, SQL and SPARK. Must know how to use Databricks...

  • Azure Databricks

    3 weeks ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time

    **About the job Azure Databricks**: **Position**: Lead - Azure Databricks **Overall IT experience**:8 to 13 years **Primary Skills**:Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse **Secondary Skills**:U-SQL, Spark, Scala, Python **Work Location**:Bengaluru, Hyderabad **Notice Period**:0 to 30 Days **Essential experience**: Experience...

  • Azure databricks

    4 days ago

    Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 5-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Azure Databricks

    2 months ago

    Bengaluru, India PradeepIT Consulting Services Pvt Ltd Full time

    Position: Lead - Azure Databricks Overall IT experience: 8 to 13 years Primary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, Python Work Location: Bengaluru, Hyderabad Notice Period: 0 to 30 Days Essential experience: Experience in building ETL / data warehouse transformation processes...

  • Azure Databricks

    5 days ago

    Bengaluru, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 5-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...

  • Data Engineering Expert for Databricks and Azure

    2 weeks ago

    Bengaluru, Karnataka, India L&T Technology Services Full time

    About the RoleWe are seeking a highly skilled Data Engineer with expertise in Databricks and Azure cloud to join our team at L&T Technology Services. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Databricks and Azure services.With 5+ years of experience in...

  • Azure Databricks Along with Python

    1 month ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Inviting Applications for Azure Databricks along with Python Job Title: Azure Databricks along with Python Experience Required: 4 to 10 Years Location: Bangalore - Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark - Proficient with...

  • Highly Skilled Azure Databricks Engineer

    5 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Tata Consultancy Services is currently seeking an experienced Azure Databricks Data Engineer to join their team.About the Role:We are looking for a skilled professional with expertise in Python, PySpark ETL notebook development and User Defined Functions. The successful candidate will be responsible for designing, implementing and maintaining data...

  • Azure Databricks Data Engineer

    1 month ago

    Bengaluru, Karnataka, India JRD Systems Full time

    **Key Responsibilities:**As an ETL Automation Specialist at JRD Systems, you will be responsible for creating test automation using an existing data automation framework to validate business rules for audience creation across multiple social media channels.The ideal candidate will have experience in Azure Databricks, building automation tests using...

  • Staff Software Engineer

    3 months ago

    Bengaluru, India Databricks Full time

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Data Engineer for Databricks and Azure Solutions

    1 week ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    The Data Engineer role at Tata Consultancy Services is an exciting opportunity to work on designing, implementing, and maintaining large-scale data processing systems on Azure.We are seeking a highly skilled Data Engineer to join our team in this key position. As a Data Engineer, you will be responsible for building scalable data pipelines using Azure Data...

  • Azure Databricks Lead/Architect

    4 weeks ago

    Bengaluru, India Recmatrix Consulting Full time

    Overview: Role of Lead/Architect - Azure Databricks focusing on designing and managing data processing systems. This position demands a strong background in both cloud-based and on-premises big data technologies, ensuring seamless integration, optimization, and management of large-scale data infrastructures.Position: Lead /Architect - Azure DatabricksOverall...