Big Data

2 days ago


Bengaluru, India AR TECHNOLOGY Full time

**Pyspark Developer**

Exp : 6-9 yrs

Location
- Bangalore /Chennai

**Job Description**:
**Key Responsibilities**:
MongoDB
- Build Machine Learning models
- Deployment on Cloud platforms

**Must have**:

- Total IT / development experience of minimum 4+ years of Big Data.
- Deep knowledge of Pyspark and libraries to develop and debug complex data engineering challenges
- Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies
- Exposure in deploying on Cloud platforms
- Development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using -Pyspark
- Development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS
- Development experience with SQL and Shell Scripting experience.

**Job Types**: Full-time, Regular / Permanent

**Salary**: ₹253,232.87 - ₹2,000,000.00 per year

Schedule:

- Morning shift

Application Question(s):

- Are you ready to relocate to the work location - Bangalore or Chennai?

**Experience**:

- 6 yrs Big Data (required)
- 4yrs coding (required)
- 1 yrs Pyspark (required)


  • Big Basket

    3 weeks ago


    Bengaluru, India big basket Full time

    What would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...

  • Big Data

    2 weeks ago


    Bengaluru, India Teamware Solutions Full time

    Job Description Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, India Acme Services Full time

    Job Description We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark, and SQL or other ETL tools, along with hands-on experience in...

  • Big Data Engineer

    15 hours ago


    Bengaluru, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - Pyspark Experience: 5 to 8 Years Location: Pune/Hyderabad Job Description Required Skills: 5+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques...

  • Big Data Engineer

    5 hours ago


    Bengaluru, India Whatjobs IN C2 Full time

    Job Title :- Data Engineer - Pyspark Experience: 5 to 8 Years Location: Pune/Hyderabad Job Description Required Skills: 5+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques...

  • Big Data Admin

    7 days ago


    Bengaluru, Karnataka, India Realign LLC Full time

    **Job Type: Full Time**: **Job Category: IT**: Job Title: Big Data Admin Job Summary: The Big Data Admin will be responsible for managing and maintaining large volumes of data within an organization. This role involves overseeing the administration of big data systems, ensuring data security, optimizing data performance, and coordinating with other team...

  • Big Data Developer

    2 weeks ago


    Bengaluru, India Pradeepit Consulting Services Full time

    Job Description L3 Big data developer: 1. Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. 2. Architect HBase schemas and data models to accommodate evolving business requirements and ensure optimal performance for data storage and retrieval operations....

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Bengaluru, India Fusion Plus Solutions Full time

    Job Description We are looking for a skilled Big Data Engineer with 5 to 7 years of hands-on experience in Big Data technologies. The ideal candidate should have strong expertise in Hadoop, HDFS, Hive, SQL, and Unix, and be able to work on large-scale data processing systems. Roles and Responsibilities: - Work on design, development, and optimization of Big...

  • Big data developer

    2 weeks ago


    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position: Bigdata DeveloperJob Location: BangaloreExperience: 6-12...