AWS Databricks Developer

18 hours ago

Bengaluru Karnataka India, Karnataka Coforge Full time

We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.


Key Responsibilities:

  • Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering.
  • Design and develop solution in combination of Cloudera, Palantir and Databricks.
  • Develop Python-based automation scripts to optimize workflows and processes.
  • Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
  • Define architecture for data-driven solutions.
  • Ensure scalability, security, and performance of deployed solutions.
  • Collaborate with business teams, data engineers, and developers to align solutions with business goals.

Mandatory Skills:

  • Databricks:
  • Expertise in design jobs and workloads.
  • Proficiency in pyspark / scala for data manipulation, transformation and analysis
  • Optimization of Databricks clusters and notebooks.
  • Python: Hands-on experience in automation and scripting.
  • Cloudera: Strong knowledge of Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management.
  • Palantir: Hands on experience with analytics, data fusion and developing analytical workflows
  • DevOps Basics: Familiarity with Jenkins CI/CD pipelines.
  • Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
  • Communication: Excellent verbal and written communication skills.
  • Fast Learner: Ability to quickly grasp new technologies and adapt to changing requirements.

Good to have skills :

  • Familiarity with containerization technologies (Docker, Kubernetes).
  • Experience with real-time streaming technologies (e.g., Kafka Streams, Spark Streaming).
  • Exposure to machine learning operationalization (MLOps) workflows.
  • Background in regulated industries with strict data compliance requirements.

Additional Information:

Certifications: Databricks Certified Associate

  • Provide solutioning for web applications and data pipelines.
  • Solutioning data analytics requirements with Palantir.
  • Stay updated with emerging technologies and quickly adapt to new tools and frameworks.
  • Work with CI/CD pipelines.

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India, Karnataka Accolade Full time

    About AccoladeThe multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront. We are building the industry's first AI-native Operations Centralization Platform, designed to streamline complex processes, unlock new efficiencies, and create better experiences for residents and operators alike. Our platform uses...

  • Databricks Developer

    4 hours ago

    Bengaluru, Karnataka, India Hyrhub Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience : 6+ Years of experience in development and maintenance in a data engineering project.Notice Period : Immediate Joiners OnlyLocation : Bangalore/Mangalore (Hybrid) Communication should be GoodJob Description : - Overall 6+ years of experience in development and maintenance in a data engineering project. - Collaborate with stakeholders to...

  • AWS Databricks Engineer

    2 days ago

    Bengaluru, Karnataka, India Changeleaders Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Looking for candidate having experience in AWS, Databricks ,Python, Pyspark.

  • Databricks Platform Engineer

    3 days ago

    Bengaluru, Karnataka, India, Karnataka Digitrix Software LLP Full time

    Experience: 3 to 6 yearsNotice Period: Immediate to 15 daysLocation: Bangalore Work from officeJOB DESCRIPTION Job Description: Databricks Platform Engineer / Administrator (AWS)Department: Data Engineering / Cloud Platform / DevOpsAbout the RoleWe are looking for a skilled and proactive Databricks Platform Engineer / Administrator to manage, optimize, and...

  • Sr. Technical Enablement Specialist

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    FEQ426R542As a Senior Technical Enablement Specialist at Databricks, you will apply your expertise in enablement to lead the design of enablement programs for Databricks Technical Support Engineers. This will include curation of content and collaboration with SMEs and/or Technical Curriculum Developers. Programs in your portfolio can include onboarding and...

  • Sr. Technical Enablement Specialist

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    FEQ426R542As a Senior Technical Enablement Specialist at Databricks, you will apply your expertise in enablement to lead the design of enablement programs for Databricks Technical Support Engineers. This will include curation of content and collaboration with SMEs and/or Technical Curriculum Developers. Programs in your portfolio can include onboarding and...

  • Databricks AWS DE Consultant

    2 days ago

    Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Mandatory SkillsBachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline 5+ years of relevant experience in data engineering roles Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and...

  • Staff Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Senior Backline Engineer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Sr Backline Engineer (Apache Spark) Mission Databricks helps data teams solve the world's toughest problems. As the leader in Unified Data Analytics, Databricks helps organizations make all their data ready for analytics, empower data-driven decisions across the organization, and rapidly adopt machine learning to outpace the competition Databricks is...

  • Senior Technical Program Manager

    7 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-1173At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...