Azure Databricks Data Engineer| 6 to 8 Years| Gyansys

3 days ago

Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 18,00,000 per year


Job Description: Data Engineer (Azure Databricks & PySpark)

Position: Data Engineer
Experience: 6 to 8 years 
Primary Skills: Azure Databricks, PySpark, SQL (M)
Secondary Skills: ADF (Azure Data Factory) (M)
Project Exposure: Cloud migration (M)
Location: Bengaluru/Hyderabad
Mode of Work: Hybrid
Salary : 13 lac to 17 lac
Notice Period: 15 to 30 Days (M)

Databricks Engineer Job Description
Responsibilities:
  • Work as part of a global distribution team to design and implement Hadoop big data solutions in alignment with business needs and project schedules.
  • 5+ years of data warehousing/engineering, software solutions design, and development experience.
  • Code, test, and document new or modified data systems to create robust and scalable applications for data analytics.
  • Work with other Big Data developers to make sure that all data solutions are consistent.
  • Partner with the business community to understand requirements, determine training needs, and deliver user training sessions.
  • Perform technology and product research to better define requirements, resolve important issues, and improve the overall capability of the analytics technology stack.
  • Evaluate and provide feedback on future technologies and new releases/upgrades.
  • Support Big Data and batch/real-time analytical solutions leveraging transformational technologies.
  • Work on multiple projects as a technical team member or drive:
    • User requirement analysis and elaboration
    • Design and development of software applications
    • Testing and build automation tools
  • Research and incubate new technologies and frameworks.
  • Experience with agile or other rapid application development methodologies and tools like Bitbucket, Jira, and Confluence.
  • Have built solutions with public cloud providers such as AWS, Azure, or GCP.
Expertise Required:
  • Hands-on experience in Databricks stack
  • Data Engineering technologies (Ex: Spark, Hadoop, Kafka, etc.)
  • Proficiency in Streaming technologies
  • Hands-on experience in Python and SQL
  • Expertise in implementing Data Warehousing solutions
  • Expertise in any ETL tool (e.g., SSIS, Redwood)
  • Good understanding of submitting jobs using Workflows, API & CLI

  • Azure Databricks Data Engineer|3 to 5 Years| Gyansys

    3 days ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description: Data Engineer (Azure Databricks & PySpark)Position: Data EngineerExperience: 3 to 12 yearsPrimary Skills: Azure Databricks, PySpark, SQLSecondary Skills: ADF (Azure Data Factory)Location: Bengaluru/HyderabadMode of Work: HybridNotice Period: 0 to 30 DaysKey Responsibilities:ETL Development & Data Processing:Design, develop, and maintain ETL...

  • Azure Databricks Engineer

    3 days ago

    Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

     Position: Azure Databricks EngineerCompany: KrtrimaIQ Cognitive SolutionsLocation: Bangalore (Hybrid / Remote)Experience: 4–8 YearsCertifications: Microsoft Certified – Azure Data Engineer Associate (DP-203) (Mandatory)About KrtrimaIQ Cognitive Solutions:At KrtrimaIQ, we are a next-generation AI & Data Engineering company enabling enterprises...

  • Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Teamware Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Greetings From Teamware Solutions We're Hiring – Azure Data Engineer | 6–8 Years Experience We are looking for a highly skilledAzure Data Engineerwith strong expertise inAzure Data Factory, PySpark, and Databricksto join our fast-growing data engineering team Location:Chennai / Bangalore / Pune / Hyderabad Experience:6–8 Years Notice Period:Immediate...

  • Azure Databricks Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Onebridge Full time ₹ 10,00,000 - ₹ 12,00,000 per year

    Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly...

  • Azure Databricks

    2 days ago

    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Lead - Azure DatabricksOverall IT experience: 8 to 13 yearsPrimary Skills: Azure Databricks, Hadoop, Hive, Pig, Impala, ETL, Data warehouse Secondary Skills: U-SQL, Spark, Scala, PythonWork Location: Bengaluru, HyderabadNotice Period: 0 to 30 Days Essential experience:Experience in building ETL / data warehouse transformation processes Direct...

  • Sr. Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GAQ126R127As aSenior Data Engineerin the IT team, you will work on variousbig data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help business to get most value out of their data.The Impact You Will...

  • Azure Databricks

    10 hours ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job DescriptionPosition: Azure DatabricksExperience: 6 to 10 yearsLocation: BengaluruNotice Period: 0-30 DaysJob DescriptionRequired Information Details1 Role – Senior Sr. DataBricks Developer2 Required Technical Skill SetAzure Databricks & Pyspark,PythonDesired Competencies (Technical/Behavioral Competency)Must-Have**Expertise in Azure Databricks &...

  • Azure Data Engineer

    10 hours ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Azure Data Engineer With DatabricksRequired Skillset: Azure Databricks, SQL, Python, PySpark, ADF, ADB.Location: HYD, Chennai, BLR, Noida, Pune, KolkataExperience Range: 4-8 yearsJob DescriptionMust-Have**1. Design, develop, and deploy data processing solutions using Azure Databricks.2. Collaborate with data engineers,...

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Tekskills Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionRole: Azure Data EngineerExperience: 5-8 yearsLocation: Gurgaon / Pune & BengaluruRole Overview:We're looking for a Data Engineer who can design, build, and maintain data pipelines and ETL processes on Azure Cloud, with strong hands-on expertise in Databricks and related Azure data tools.Key Skills Required:Azure Databricks – hands-on...

  • DataBricks Consultant

    2 weeks ago

    Bengaluru, Karnataka, India GyanSys Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    In this position you will be responsible for providing insights to clients. To do so, you will first meet with our clients to uncover their business needs and challenges. Then, you will use your strong analytical skills to perform quantitative and observational data analyses. From these analyses, you will form and present your recommendations to our...