Pyspark + Databricks

2 weeks ago

Hyderabad Telangana, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Develop and maintain scalable data pipelines using Databricks SQL and Databricks Workflows.
- Implement and optimize PySpark code for data processing and analytics.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure data quality and integrity through rigorous testing and validation.
- Provide technical guidance and support to junior developers.
- Monitor and troubleshoot data pipeline performance and resolve issues promptly.
- Participate in code reviews to maintain high coding standards.
- Stay updated with the latest industry trends and technologies in data engineering.
- Contribute to the continuous improvement of development processes and best practices.
- Document technical specifications and maintain comprehensive project documentation.
- Work closely with stakeholders to gather requirements and provide timely updates on project progress.
- Utilize domain knowledge in Cards & Payments to enhance data solutions.
- Ensure compliance with data security and privacy regulations.

**Qualifications**
- Possess strong expertise in Databricks SQL and Databricks Workflows.
- Demonstrate proficiency in PySpark for data processing and analytics.
- Have experience in developing and maintaining scalable data pipelines.
- Show ability to collaborate effectively with cross-functional teams.
- Exhibit strong problem-solving skills and attention to detail.
- Have knowledge of data quality and validation techniques.
- Possess excellent communication and documentation skills.
- Experience in the Cards & Payments domain is a plus.
- Familiarity with data security and privacy regulations is desirable.
- Ability to work in a hybrid work model with day shifts.
- Minimum of 6 years and maximum of 10 years of relevant experience.
- Bachelors degree in Computer Science Engineering or a related field is preferred.
- Strong commitment to continuous learning and professional development.

  • Databricks Pyspark

    3 weeks ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description - Develop and optimize data processing jobs using PySpark to handle complex data transformations and aggregations efficiently. - Design and implement robust data pipelines on the AWS platform, ensuring scalability and efficiency. - Leverage AWS services such as EC2, S3 for comprehensive data processing and storage solutions. - Manage SQL...

  • Databricks, SQL, PySpark, Python

    3 weeks ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description Roles and Responsibilities - 5+ years of experience on IT industry in Data Engineering & Data Analyst role. - 5 years of development experience using tool Databricks and PySpark, Python, SQL - Proficient in writing SQL queries including writing of windows functions - Good communication skills with analytical abilities in doing problem solving...

  • ML Engineer

    2 days ago

    Hyderabad, India Tiger Analytics Full time

    Job Description ML Engineer (Databricks + PySpark) Locations: Chennai / Hyderabad / Bangalore Tiger Analytics is a global leader in AI and analytics, helping Fortune companies solve their toughest challenges. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively. Come...

  • ▷ (Immediate Start) Python, Pyspark, DataBricks

    3 weeks ago

    Hyderabad, India Fusion Plus Solutions Full time

    Job Description - Total Yrs. of Experience6+Relevant Yrs. of experience5+Detailed JD (Roles and Responsibilities)5+ years of hands-on Python development experience with excellent programming skills, 3+ years of experience with cloud-based platform, ideally Microsoft Azure, working experience and skills on big data technologies such as PySpark, Databricks,...

  • Azure Databricks- Hyderabad

    1 week ago

    Hyderabad, Telangana, India Cognizant Full time

    **Skill**: Azure Databricks **Experience**: 4 to 16 years **Location**: Hyderabad **Walkin date**: 8th Feb 25 - **Hands on experience with Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions.** - **In-depth knowledge of relational database design,...

  • PySpark Developer

    1 week ago

    Hyderabad, Telangana, India algoleap Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • Pyspark Developer

    3 days ago

    Hyderabad, Telangana, India NTT DATA Business Solutions Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job SummaryWe are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams.Key...

  • Azure Databricks

    4 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Azure Databricks Greetings from TCS!! ! TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before...

  • eSoftLabs - PySpark Developer

    3 weeks ago

    Hyderabad, India ENTERPRISE SOFTLABS PRIVATE LINITED Full time

    Job Title : Pyspark DeveloperLocation : HyderabadExperience Required : 4- 8Keywords : AWS, Pyspark, Databricks Skills and experiences required :- 3- 6 years of hands-on development in PySpark.- Experience with Databricks and performance tuning using Spark UI.- Strong understanding of AWS services, Kafka, and distributed data processing.- Proficient in...

  • Azure Databricks

    4 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Azure Databricks Greetings from TCS!!! TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before...