Databricks & AWS Lead

2 days ago

Bengaluru Chennai Hyderabad, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

We are looking for a skilled Databricks & AWS Lead with 7-14 years of experience to join our team in Pune, Mumbai, Chennai, Hyderabad, Bangalore, and Noida. The ideal candidate will have expertise in Databricks and AWS, Unity Catalog, Spark, SQL, and Python.

Roles and Responsibility

  • Design and implement data pipelines using Databricks and AWS.
  • Develop and maintain big data technologies and data warehousing solutions.
  • Create CI/CD pipelines using Jenkins or GitLab CI/CD.
  • Collaborate with cross-functional teams to identify and prioritize project requirements.
  • Troubleshoot and resolve technical issues related to Databricks and AWS.
  • Ensure data quality and integrity by implementing data validation and testing procedures.

Job Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Minimum 7 years of experience in Databricks and AWS.
  • Strong knowledge of Databricks, AWS, Unity Catalog, Spark, SQL, and Python.
  • Experience with big data technologies and data warehousing solutions.
  • Familiarity with CI/CD pipelines and tools like Jenkins or GitLab CI/CD.
  • Excellent problem-solving skills and attention to detail.
  • Notice period: days.Location - Bengaluru,Chennai,Hyderabad,Mumbai,Noida,Pune

  • AWS Data Engineer- Sagemaker

    1 week ago

    Bengaluru, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, PythonSecondary skillset : Any ETL Tool, Github, DevOPs(CI-CD)Mandatory Skill Set:Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applicationsStrong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue,...

  • AWS Data Engineer- Sagemaker

    3 days ago

    Bengaluru, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, PythonSecondary skillset : Any ETL Tool, Github, DevOPs(CI-CD)Mandatory Skill Set:Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applicationsStrong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue,...

  • AWS Data Engineer- Sagemaker

    6 days ago

    Bengaluru, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, PythonSecondary skillset : Any ETL Tool, Github, DevOPs(CI-CD)Mandatory Skill Set:- Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applications- Strong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue,...

  • AWS Data Engineer- Sagemaker

    1 week ago

    Bengaluru, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset : Any ETL Tool, Github, DevOPs(CI-CD) Mandatory Skill Set: - Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applications - Strong understanding and hands-on experience with AWS services like EC2, S3, EMR,...

  • Aws data engineer- sagemaker

    1 week ago

    Bengaluru, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset : Any ETL Tool, Github, Dev OPs(CI-CD) Mandatory Skill Set: Python, Py Spark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applicationsStrong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue,...

  • AWS Data Engineer- Sagemaker

    3 days ago

    Bengaluru, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, PythonSecondary skillset : Any ETL Tool, Github, DevOPs(CI-CD)Mandatory Skill Set:- Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applications- Strong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue,...

  • AWS Data Engineer- Sagemaker

    1 week ago

    Bengaluru, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset : Any ETL Tool, Github, DevOPs(CI-CD) Mandatory Skill Set: Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applicationsStrong understanding and hands-on experience with AWS services like EC2, S3, EMR, Glue,...

  • AWS Data Engineer- Sagemaker

    7 days ago

    Bengaluru, India YASH Technologies Full time

    Primary skillsets : AWS services including Glue, Pyspark, SQL, Databricks, Python Secondary skillset : Any ETL Tool, Github, DevOPs(CI-CD) Mandatory Skill Set: Python, PySpark , SQL, AWS with Designing, developing, testing and supporting data pipelines and applications Strong understanding and hands-on experience with AWS services like EC2, S3, EMR,...

  • Databricks Setup with Aws

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Description: We are looking for a Databricks Setup Specialist to lead the deployment and configuration of Databricks on AWS, focusing on PrivateLink integration and Unity Catalog administration. This role involves collaboration with AWS DevOps and Security teams to create a secure and compliant data platform. Key Responsibilities: Deploy Databricks...

  • AWS Databricks

    7 days ago

    Bengaluru, India Cognizant Full time

    Job Summary We are seeking a AWS Databricks with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Spark in Scala Delta Sharing and Databricks Unity Catalog . This role involves working with cutting-edge technologies like Databricks CLI Delta Live Pipelines and Structured Streaming. The candidate will play a crucial...