Pyspark

7 days ago

Chennai, India SRM Technologies Full time

SRM Technologies is a global IT services provider offering Cloud and Infrastructure, Digital Transformation, Data and AI, Application Lifecycle, Technology Consulting, Quality Assurance, eCommerce and Product Engineering services.

The key industries that benefit from our offerings include Automotive, Manufacturing and Consumer Goods. We offer our customers the ability to not only manage their existing IT landscape but also help them embrace the digital future - by crafting their roadmap to enhance frontend customer touchpoints, in addition to their backend processes.

We are part of the SRM Group, a multinational conglomerate that has been in business for over four decades and operates in Education, Technology, Healthcare and Media sectors.

At least 5 years of experience in Big Data, Hadoop Data Platform (HDP) and ETL and capable of configuring data pipelines.
- At least 2 years of experience in Cloud era Data Platform (CDP)

**Requirements**:

- Skills and experience to support the upgrade from Hadoop to Cloudera.
- Good knowledge of Industry Best Practice for ETL Design, Principles, Concepts.
- Possess the following technical skills - SQL, Python, Pyspark, Hive, Unix, ETL, Control-M (or similar)
- Data Extraction from Teradata, HIVE, Oracle, and Flat files
- Ability to work independently on specialized assignments within the context of project deliverables
- Take ownership of providing solutions and tools that iteratively increase engineering efficiencies.
- Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of Data Pipelines
- Communicate openly and honestly. Advanced oral, written and visual communication and presentation skills - the ability to communicate efficiently at a global level is paramount.
- Ability to deliver materials of the highest quality to management against tight deadlines.
- Ability to work effectively under pressure with competing and rapidly changing priorities.

Excellent communication skills & team player

**Benefits**:

- Work from SRM Tech

City

Chennai

State/Province

Tamil Nadu

Country

India

Zip/Postal Code

600096

Industry

Technology

  • PySpark Developers

    2 days ago

    Chennai, Tamil Nadu, India LTIMindtree Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Skill : PySpark DeveloperJob Locations : Chennai, PuneNotice Period : AnyExperience : 3-8 years Job Description :PySpark DeveloperMandatory Skills : (Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, Python)A good professional experience in Bigdata PySpark HIVE Hadoop PLSQLGood knowledge of AWS and SnowflakeGood understanding of CICD and system design...

  • Data Engineer- PySpark

    2 days ago

    Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Build up data pipelines for consumption by the data science team.Clear understanding and experience with Python and PySpark.Experience in writing Python programs and SQL queries.Experience in SQL Query tuning.Build and maintain data pipelines in Pyspark with SQL and Python.Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best...

  • Pyspark Developer

    2 days ago

    Bengaluru, Chennai, Pune, India Tekskills Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    JOB SUMMARY:Experience 6+years (relevant minimum 5+ years)Detailed job description - Skill Set:Candidate should have good hands on experience in Pyspark preferrable more than 7 years.Should have very good understanding of Agile development methodologies and excellent team handling experience.Mandatory Skills - Pyspark, Python, Agile

  • Pyspark+databricks

    5 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Exp: 4 to 13 years** **Skill: Data Bricks+Pyspark** **Location : Bangalore/Hyderabad/Kolkota/Pune/Chennai** **Technical Skills**: Python,PySpark,Azure Data Lake Store,Databricks Workflows,Databricks SQL **Responsibilities**: - Develop and optimize data solutions using Azure Data Lake Store to support business needs. - Utilize Python to create...

  • Pyspark Developer

    2 days ago

    Bengaluru, Chennai, Pune, India VHR Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Description:We are looking for a skilled PySpark Developer to join our data engineering team. The ideal candidate will have strong experience in building scalable data pipelines using Apache Spark (PySpark), integrating with big data platforms, and working with large datasets in distributed environments. You will work closely with data engineers,...

  • Pyspark

    7 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and maintain data solutions using Databricks SQL Databricks Delta Lake and Databricks Workflows. - Optimize and enhance existing data workflows to improve performance and efficiency. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. -...

  • Python/pyspark

    3 days ago

    Chennai, Tamil Nadu, India Mastech InfoTrellis Full time

    **Skills required**: Python & PySpark Machine Learning & AI Data Management & SQL Containerization Orchestration Problem-Solving & Algorithms **Education/Qualification**: Python/PySpark **Desirable skills**: CI/CD & DevOps, Big Data Processing **Years of experience**: 15+ Years **Position**:Python/PySpark** **Duties & Responsibilities**: - Use the...

  • PySpark Developer

    5 days ago

    Bengaluru / Bangalore, Chennai, Pune, India beBeeData Full time US$ 1,04,000 - US$ 1,30,878

    Job SummaryWe are seeking a highly skilled PySpark expert with hands-on experience in Databricks to join our data engineering team. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform.Key Responsibilities:Develop and manage data pipelines using PySpark on...

  • Pyspark - Hyderabad

    1 week ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **RR: - 60137021** **Job Title: - Data Engineer with Pyspark** **Location: -**Kolkata** **Job Type 3 days from office (Hybrid)** **Responsibilities**: - 2+ years of Experience with AWS Cloud on data integration with Spark & AWS Glue/EMR - In-depth understanding of Spark architecture & distributed systems - Good exposure to Spark job optimizations -...

  • Pyspark Developer

    2 days ago

    Bengaluru, Chennai, Pune, India Quess Corp Limited Full time US$ 1,04,000 - US$ 1,30,878 per year

    ROLE SUMMARYWe are seeking a highly skilled PySpark Developer with hands-on experience in Databricks IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data...