Bigdata (Pyspark, Hive)

2 months ago


Chennai Tamil Nadu, India Tata Consultancy Services Full time

Experience Range: 4 Years to 8 Years

Location: Chennai

**Job Description**:

- Experience in Pyspark and Hive, HBase
- Proficiency in integrating, transforming, andconsolidating data from various structured and unstructured datasources.
- Good experience in SQL or native SQL querylanguages.
- Good experience in PySpark, Hive, Hbase, Hadoop
- Advanced working knowledge in building robustdata ingestion.
- Experience in building processes supporting datatransformation, data structures, metadata, dependency and workload management.
- Exposure to basic issues in working within BigData cluster

Qualifications :BACHELOR OF TECHNOLOGY


  • BigData Engineer

    1 week ago


    Chennai, Pune, India Talodyn Networks Private Limited Full time

    Bigdata Developer with PYSpark expStrong experience in PySpark.Strong experience with Python in writing test-cases and Experience in error logging and debugging.Strong experience in Spark, Unix scripting, SparkSQL, Hive.Experience in writing SQLs using Oracle.Excellent oral and written communication skills is a must.Experience in banking is an added...

  • Bigdata Python

    6 months ago


    Chennai, Tamil Nadu, India RF workforce Solutions Full time

    Skill: Bigdata with Python & Pyspark Yrs of experience: 5+ yrs Notice: preferable immediate **Job Types**: Full-time, Temporary Contract length: 6 months Pay: ₹60,000.00 - ₹82,000.00 per month Schedule: - Monday to Friday **Experience**: - Big data: 5 years (required) - python: 5 years (required) - pyspark: 5 years (required) Work Location: In...

  • Pyspark Developer

    4 weeks ago


    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    About the RoleWe are seeking an experienced Data Engineer with Pyspark expertise to join our team at Krishpar Technologies Pvt. Ltd.Key ResponsibilitiesDevelop Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Build Machine Learning models using Pyspark.Deploy applications on Cloud platforms.RequirementsAt least 4-7 years...

  • BigData Developer

    1 month ago


    Chennai, India Kiash Solutions LLP Full time

    4 + years of expertise and hands on experience in Spark with Scala and Big data technologies Good working experience in Scala and object oriented concepts Good working experience in HDFS, Spark, Hive and Oozie Technical expertise with data models, data mining, and partitioning techniques Hands-on experience with SQL database Have good understand on CI/CD...

  • Pyspark Dev

    6 months ago


    Chennai, Tamil Nadu, India Virtusa Full time

    Pyspark Dev & QA Mandatory Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySpark Build CI/CD pipelines is required Outstanding coding, debugging and analytical skills Spark APIs to cleanse, explore, aggregate, transform, store & analyse available data Knowledge of installing, configuring, debugging...


  • Chennai, India Krishpar Technologies Pvt. Ltd Full time

    Dear candidates,We are hiring for one of our client (MNC) Position : Pyspark DeveloperExperience: 4- 6 YaersLocation: Chennai, BangaloreJob Description: Big Data Testing on Hadoop, Hive, etc., using HiveQL, MapReduce or other big data technologies for automated validation Implementing DevOps / CI-CD using Bitbucket, Jenkins, etc., ...

  • Bigdata ETL Developer

    4 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Key Responsibilities: Hands on with in-depth knowledge in BigData ETL Testing.Hands on experience in Hadoop and Hive is a must.Develop Test specifications based on various requirement documents within schedule constraints.Plan and execute activities in relation to test preparation, automation, execution, and reporting.Perform functional and technical test...


  • Chennai, Tamil Nadu, India Techno Wise Full time

    We are seeking a highly skilled PySpark Developer to join our team at Techno Wise. As a key member of our data engineering team, you will be responsible for designing and building scalable data solutions using PySpark.Key Responsibilities:Design, build, and unit test applications in Spark/PysparkDevelop in-depth knowledge of Hadoop, Spark, and similar...


  • Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    About the Role:We are seeking a highly skilled Pyspark Developer to join our team at Krishpar Technologies Pvt. Ltd.Responsibilities:Our ideal candidate will have experience in Big Data testing on Hadoop, Hive, and other technologies using HiveQL, MapReduce, and other big data tools for automated validation.They will also be responsible for implementing...

  • Pyspark Developer

    1 month ago


    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    Pyspark Developer Job DescriptionWe are seeking a highly skilled Pyspark Developer to join our team at Krishpar Technologies Pvt. Ltd. The ideal candidate will have experience in developing Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Key Responsibilities:Design and develop scalable and efficient Big Data applications...

  • Bigdata ETL-Testing

    8 months ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Hands on with In-depth knowledge in BigData ETL Testing Experience in Hadoop Hive is a must ETL test automation experience Cloudera experience is good to have Python/spark experience is added advantage Plan and execute activities in relation to test preparation, automation, execution, and reporting Develop Test specifications based on various requirement...

  • Bigdata

    3 months ago


    Chennai, Tamil Nadu, India Virtusa Full time

    5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Advanced knowledge of the Hadoop...

  • Big Data Developer

    4 weeks ago


    Chennai, India Globalemployees.com Full time

    Position Name : Big Data developerDesired Skills and Experience :- AWS, EC2, HDFS, HQL, EMR, Sqoop- Strong Knowledge of Bigdata and Hadoop ecosystems like HDFS, Spark, MapReduce, Sqoop, Hive and AWS.- Experience in Loading and transforming large sets of structured, semi-structured and unstructured data from Relational Database Systems to HDFS and vice-versa...

  • Bigdata

    1 week ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. As an Analyst, you will specialize in requirement gathering and to analyze the same in respective areas. Your role is of key importance, as it lays down the foundation for the...

  • BigData - Tech Lead

    5 months ago


    Chennai, India Virtusa Full time

    BigData - Tech Lead - CREQ186711 Description Job Description: Responsibilities: Responsible for Design, Build & deployment the Solution in Bigdata. Ability to effectively use complex analytical, interpretive and problem solving techniques. Analytical, flexible, team-oriented and has good interpersonal/communication skills. Apply...


  • Chennai, India Cynosure Corporate Solutions Full time

    Skills &Experience:10years of design & development experience with big datatechnologies like Azure AWS orGCPMinimum 6Years in PysparkExperiencePreferred is Azure& Databricks with experience in AzureDevOpsExperience in datavisualizing technology in DL likePowerBIProficient in Python PySparkand SQLProficient in querying andmanipulating data from various DB...

  • Data Engineer

    3 months ago


    Chennai, India TekPillar Full time

    Job Title : Data EngineerExperience : 3-8 YearsLocation : Chennai / BangaloreJob Type : Full-timeRequire Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, PythonJob Description :We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience.- Strong experience with AWS services: Glue,...

  • Data Engineer

    3 weeks ago


    tamil nadu, India Tata Consultancy Services Full time

    TCS Hiring !!!! VIRTUAL DRIVE: Azure Data Engineer Developer : 07-November-24 NOTE: If the skills/profile matches and interested, please reply to this email by attaching your latest updated CV and with below few details: Name: Contact Number: Email ID: Highest Qualification in: (Eg. B.Tech/B.E./M.Tech/MCA/M.Sc./MS/BCA/B.Sc./Etc.) Current Organization...

  • Data Engineer

    3 weeks ago


    tamil nadu, India Tata Consultancy Services Full time

    TCS Hiring !!!! VIRTUAL DRIVE: Azure Data Engineer Developer : 07-November-24 NOTE: If the skills/profile matches and interested, please reply to this email by attaching your latest updated CV and with below few details: Name: Contact Number: Email ID: Highest Qualification in: (Eg. B.Tech/B.E./M.Tech/MCA/M.Sc./MS/BCA/B.Sc./Etc.) Current Organization...


  • chennai, India Tata Consultancy Services Full time

    TCS Hiring!!!! Walk in DRIVE: 06 December 2024 Location: ChennaiFace to Face interviewNOTE: If the skills/profile matches and interested, please reply to this email by attaching your latest updated CV and with below few details:Scala,Bigdata,Spark Name:Contact Number:Email ID:Highest Qualification in: (Eg....