Big Data Developer

4 weeks ago

Chennai, India Virtusa Full time
Big Data Developer - CREQ Description Job Description:
5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive
Bachelors or masters degree in Computer Science or related field
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Advanced knowledge of the Hadoop ecosystem and its components
In-depth knowledge of Hive, Shell scripting, Python, Spark
Ability to write MapReduce jobs
Experience using Job Schedulers like Autosys
Hands on experience in HiveQL
Good knowledge on Hadoop Architecture and HDFS
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Experience with jenkins for Continuous Integration
Experience using Source Code and Version Control Systems like Bitbucket, Git
Good to have experience on Agile Development
Responsibilities: Develop components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset
Participates and guides team in estimating work necessary to realize a story/requirement through the software delivery lifecycle
Responsible for developing and delivering complex software requirements to accomplish business goals
Ensures that software is developed to meet functional, non-functional, and compliance requirements
Codes solutions, Unit testing and ensure the solution can be integrated successfully into the overall application/system with clear robust, and well-tested interfaces

Required Skills: Hadoop, Hive, HDFS, Spark, Python, Unix
Nice to have skills: AML Domain knowledge
Primary Location Chennai, Tamil Nadu, India Job Type Experienced Primary Skills PySpark, Kafka, ANSI SQL, Cloudera Data platform Years of Experience 5 Qualification

Job Description:
5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive
Bachelors or masters degree in Computer Science or related field
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Advanced knowledge of the Hadoop ecosystem and its components
In-depth knowledge of Hive, Shell scripting, Python, Spark
Ability to write MapReduce jobs
Experience using Job Schedulers like Autosys
Hands on experience in HiveQL
Good knowledge on Hadoop Architecture and HDFS
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Experience with jenkins for Continuous Integration
Experience using Source Code and Version Control Systems like Bitbucket, Git
Good to have experience on Agile Development
Responsibilities: Develop components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset
Participates and guides team in estimating work necessary to realize a story/requirement through the software delivery lifecycle
Responsible for developing and delivering complex software requirements to accomplish business goals
Ensures that software is developed to meet functional, non-functional, and compliance requirements
Codes solutions, Unit testing and ensure the solution can be integrated successfully into the overall application/system with clear robust, and well-tested interfaces

Required Skills: Hadoop, Hive, HDFS, Spark, Python, Unix
Nice to have skills: AML Domain knowledge

Travel No

  • Big data developer

    3 weeks ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python)Experience : 5+ YearsLocations : Chennai, Bangalore, GurugramEmployment Type : Full-TimeNotice Period : Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Big Data Developer

    23 hours ago

    Chennai, Tamil Nadu, India Net2Source Full time ₹ 2,50,000 - ₹ 7,50,000 per year

    Big Data Developer Skills Required: Big Data & Hadoop Ecosystem, Python, PySpark Experience: 5-10 Years Share your updated resume now.

  • Big Data Developer

    4 weeks ago

    Chennai, India IntraEdge Full time

    Job Title: Senior Big Data Engineer (Python)Experience: 5+ YearsLocations: Chennai, Bangalore, GurugramEmployment Type: Full-TimeNotice Period: Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Big Data Developer

    4 weeks ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python) Experience : 5+ Years Locations : Chennai, Bangalore, Gurugram Employment Type : Full-Time Notice Period : Immediate to 30 Days Preferred Job Summary We are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions....

  • Big Data Developer

    4 weeks ago

    Chennai, India Chiselon Technologies Pvt Ltd Full time

    Hiring!!! We are hiring for one of our client!!! Position - Big Data Engineer Experience - 5+years Location - Chennai, Bangalore Work Mode - Hybrid Notice Period - Immediate Joiners(Seving Notice Period within 15days only) Job Overview We are seeking a skilled Big Data Developer to join our team in a mid-level position. This full-time , hybrid ...

  • Big Data Developer

    4 weeks ago

    Chennai, India Virtusa Full time

    Big Data Developer - CREQ Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in...

  • Senior Big Data Developer

    1 week ago

    Chennai, Tamil Nadu, India MOURI Tech Foundation Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key ResponsibilitiesDevelop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.Implement ETL/ELT workflows and ensure data...

  • Big Data Developer

    1 week ago

    Bengaluru, Chennai, India Terrabit Consulting Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Skills required: Pyspark, Python, SQL/ Scala and Unix scriptingExperience in Big Data technologiesExperience in writing SQLsHaving work experience in Control-M/Airflow and DevOps will be advantageGood to have knowledge on Banking & Money Laundering .Should have excellent programming scripts, Debugging and analytical thinking.Experience across all stages of...

  • Big Data Developer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    4+ years of hands on development experience in programming languages such as JAVA,SCALA using Maven, Apache Spark Frameworks and Unix Shell scriptingShould be comfortable with Unix File system as well as HDFS commandsShould have worked on query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, HBase DB Should be flexibleShould have good...

  • Big Data Developer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu IntraEdge Full time

    Job Title: Senior Big Data Engineer (Python)Experience: 5+ YearsLocations: Chennai, Bangalore, GurugramEmployment Type: Full-TimeNotice Period: Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...