AWS Databricks Developer

3 weeks ago

Bengaluru Karnataka India, Karnataka Coforge Full time

We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.


Key Responsibilities:

  • Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering.
  • Design and develop solution in combination of Cloudera, Palantir and Databricks.
  • Develop Python-based automation scripts to optimize workflows and processes.
  • Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
  • Define architecture for data-driven solutions.
  • Ensure scalability, security, and performance of deployed solutions.
  • Collaborate with business teams, data engineers, and developers to align solutions with business goals.

Mandatory Skills:

  • Databricks:
  • Expertise in design jobs and workloads.
  • Proficiency in pyspark / scala for data manipulation, transformation and analysis
  • Optimization of Databricks clusters and notebooks.
  • Python: Hands-on experience in automation and scripting.
  • Cloudera: Strong knowledge of Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management.
  • Palantir: Hands on experience with analytics, data fusion and developing analytical workflows
  • DevOps Basics: Familiarity with Jenkins CI/CD pipelines.
  • Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
  • Communication: Excellent verbal and written communication skills.
  • Fast Learner: Ability to quickly grasp new technologies and adapt to changing requirements.

Good to have skills :

  • Familiarity with containerization technologies (Docker, Kubernetes).
  • Experience with real-time streaming technologies (e.g., Kafka Streams, Spark Streaming).
  • Exposure to machine learning operationalization (MLOps) workflows.
  • Background in regulated industries with strict data compliance requirements.

Additional Information:

Certifications: Databricks Certified Associate

  • Provide solutioning for web applications and data pipelines.
  • Solutioning data analytics requirements with Palantir.
  • Stay updated with emerging technologies and quickly adapt to new tools and frameworks.
  • Work with CI/CD pipelines.

  • AWS Databricks Engineer

    2 days ago

    Bengaluru, Karnataka, India Changeleaders Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Looking for candidate having experience in AWS, Databricks ,Python, Pyspark.

  • Databricks Developer

    20 hours ago

    Bengaluru, Karnataka, India Hyrhub Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience : 6+ Years of experience in development and maintenance in a data engineering project.Notice Period : Immediate Joiners OnlyLocation : Bangalore/Mangalore (Hybrid) Communication should be GoodJob Description : - Overall 6+ years of experience in development and maintenance in a data engineering project. - Collaborate with stakeholders to...

  • Databricks AWS DE Analyst

    17 hours ago

    Bengaluru, Karnataka, India BSR & Co Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    DescriptionBachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline1+ years of relevant experience in data engineering rolesDetailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and...

  • Sr. Technical Enablement Specialist

    9 hours ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ426R542As a Senior Technical Enablement Specialist at Databricks, you will apply your expertise in enablement to lead the design of enablement programs for Databricks Technical Support Engineers. This will include curation of content and collaboration with SMEs and/or Technical Curriculum Developers. Programs in your portfolio can include onboarding and...

  • Salesforce Developer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Salesforce Developer GAQ326R174 Our Databricks Business Systems Team is looking for a Salesforce Developer to manage our Salesforce platform and be a strategic partner in using this core system across the business. Reporting to the Senior Manager of Business Systems, you will own the process for design, test, build and implementation. Additionally...

  • Databricks Platform Engineer

    4 weeks ago

    Bengaluru, Karnataka, India, Karnataka Digitrix Software LLP Full time

    Experience: 3 to 6 yearsNotice Period: Immediate to 15 daysLocation: Bangalore Work from officeJOB DESCRIPTION Job Description: Databricks Platform Engineer / Administrator (AWS)Department: Data Engineering / Cloud Platform / DevOpsAbout the RoleWe are looking for a skilled and proactive Databricks Platform Engineer / Administrator to manage, optimize, and...

  • Databricks AWS DE Analyst

    6 days ago

    Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Bachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline 1+ years of relevant experience in data engineering roles Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data...

  • Business Development Representative

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 3,00,000 - ₹ 6,00,000 per year

    BDR SLSQ326R415 Databricks is at the forefront of the Unified Data Analytics field, where innovation is key to providing our clients with a competitive edge in today's fast-paced business landscape. We are looking for a Business Development Representative to help drive revenue growth within the India Market. If you're a results-oriented sales...

  • Technical Enablement Specialist

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Sr. Technical Enablement Specialist FEQ426R542 As a Senior Technical Enablement Specialist at Databricks, you will apply your expertise in enablement to lead the design of enablement programs for Databricks Technical Support Engineers. This will include curation of content and collaboration with SMEs and/or Technical Curriculum Developers. Programs in...

  • Sr. Technical Enablement Specialist

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    FEQ426R542As a Senior Technical Enablement Specialist at Databricks, you will apply your expertise in enablement to lead the design of enablement programs for Databricks Technical Support Engineers. This will include curation of content and collaboration with SMEs and/or Technical Curriculum Developers. Programs in your portfolio can include onboarding and...