AWS PySpark Databricks Developer

23 hours ago

andhra pradesh, India Tata Consultancy Services Full time

Opportunity with TCS Role: AWS PySpark Databricks Developer Location: VishakhapatnamI hope you're doing well I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCSRole: AWS PySpark Databricks DeveloperLocation: VishakhapatnamMode: Full TimeExperience: 6+ YearsRelevant Experience(in Yrs) 5-6 years+Technical/Functional Skills • 5–6 years of total experience in data engineering or big data development. • 2–3 years hands-on experience with Databricks and Apache Spark. • Proficient in AWS cloud services (S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM). • Strong programming skills in PySpark, Python, and optionally Scala. • Solid understanding of data lakes, lakehouses, and Delta Lake concepts. • Experience in SQL development and performance tuning. • Familiarity with Airflow, dbt, or similar orchestration tools is a plus. • Experience in CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline. • Knowledge of data security, governance, and compliance frameworks.Experience Required 5-6 years+Roles & Responsibilities •Develop and maintain scalable data pipelines using Apache Spark on Databricks. • Build end-to-end ETL/ELT pipelines on AWS using services like S3, Glue, Lambda, EMR, and Step Functions. • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions. • Design and implement data models, schemas, and Lakehouse architecture in Databricks. • Optimize and tune Spark jobs for performance and cost-efficiency. • Integrate data from multiple structured and unstructured data sources. • Monitor and manage data workflows, ensuring data quality, consistency, and security. • Follow best practices in CI/CD, code versioning (Git), and DevOps practices for data applications. • Write clean, reusable, well-documented code using Python / PySpark / Scala.

  • AWS PySpark Databricks Developer

    2 days ago

    andhra pradesh, India Tata Consultancy Services Full time

    Opportunity with TCS Role: AWS PySpark Databricks Developer Location: Vishakhapatnam I hope you're doing well! I came across your profile and was impressed by your extensive experience as an/a (mention role/skill). We have a similar opportunity to join our dynamic team at TCS Role: AWS PySpark Databricks Developer Location: Vishakhapatnam Mode: Full Time...

  • Aws Databricks

    2 weeks ago

    Andhra Pradesh, India Virtusa Full time

    Must have 7plus years of experience total IT experience in Data engineering DW area Must have 3plus yrs of exposure on AWS ecosystem specifically DataBricks, Redshift Lambda Glue Starbust Minimum 5 yrs of technical expertise with data models data mining and segmentation techniques Expert on programming languages SQL Python Pyspark Must be good at...

  • AWS Glue- Pyspark Dev_Offshore

    4 weeks ago

    Amaravati, Andhra Pradesh, India Growel Softech Private Limited Full time

    Job Description We are seeking a skilled AWS Glue / Snowflake Developer to design and develop data and analytics solutions from scratch. The ideal candidate will have hands-on experience with AWS services and Snowflake, along with expertise in PySpark for building scalable and efficient data pipelines. Primary Responsibilities: - Design and develop data...

  • IN | Travelers_ BC: AWS Glue- Pyspark Dev_Offshore

    4 weeks ago

    Amaravati, Andhra Pradesh, India Growel Softech Private Limited Full time

    Job Description Key Responsibilities: - Data Pipeline Development: Design and implement data pipelines from scratch using AWS Glue and PySpark. - Cloud Services Integration: Work with AWS services including S3, DynamoDB, Step Functions, and others for scalable data solutions. - Snowflake Development: Design, develop, and maintain data models, ETL processes,...

  • Azure Databricks

    3 days ago

    uttar pradesh, India Tata Consultancy Services Full time

    Greetings From TCS!!! "Opportunities don't happen, you create them" Job Title: Azure Databricks Exp Range: 4-10 Years Job Location: Noida or Bangalore or Chennai or Hyderabad or Kolkata Job Description: Required skill: Azure Databricks, PySpark and Python. Must have: 1.Azure Data Bricks (Python) 2.Pyspark 3. ADLS 4. complex problem solving skill Good to...

  • Databricks- SAS skill engineer

    4 weeks ago

    Bilaspur, Uttar Pradesh, India Growel Softech Private Limited Full time

    Job Description Key Responsibilities: - Code Interpretation: Read, understand, and interpret SAS code to relay functional logic to Databricks developers. - Code Conversion: Perform end-to-end SAS-to-Python/PySpark code conversion for Databricks implementation. - Technical Guidance: Provide Databricks platform guidance and best practices to the team during...

  • Azure Databricks

    4 days ago

    uttar pradesh, India Tata Consultancy Services Full time

    Greetings From TCS!!!"Opportunities don't happen, you create them"Job Title: Azure DatabricksExp Range: 4-10 YearsJob Location: Noida or Bangalore or Chennai or Hyderabad or KolkataJob Description:Required skill: Azure Databricks, PySpark and Python.Must have: 1.Azure Data Bricks (Python)2.Pyspark3. ADLS4. complex problem solving skillGood to Have: 1.Azure...

  • Cloudera

    5 days ago

    Andhra Pradesh, India Virtusa Full time

    Design, develop, and maintain data pipelines and ETL processes using Databricks. Manage and optimize data solutions on cloud platforms such as Azure and AWS. Implement big data processing workflows using PySpark. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions. Ensure data...

  • Cloudera

    5 days ago

    Andhra Pradesh, India Virtusa Full time

    Job Description: Design, develop, and maintain data pipelines and ETL processes using Databricks. Manage and optimize data solutions on cloud platforms such as Azure and AWS. Implement big data processing workflows using PySpark. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective...

  • Azure Databricks

    3 weeks ago

    Noida, Uttar Pradesh, India, Ghaziabad Tata Consultancy Services Full time

    Greetings From TCS!!!"Opportunities don't happen, you create them"Job Title: Azure DatabricksExp Range: 4-10 YearsJob Location: Noida or Bangalore or Chennai or Hyderabad or KolkataJob Description:Required skill: Azure Databricks, PySpark and Python.Must have: 1.Azure Data Bricks (Python)2.Pyspark3. ADLS4. complex problem solving skillGood to Have: 1.Azure...