Big Data Engineer

4 weeks ago

HyderabadBangalore, India HRwing Full time

Role & Responsibilities:

Good development practices:

  • Hands on coder with good experience in programming languages like Java or Python .
  • Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.
  • Good understanding of programming principles and development practices like checkin policy, unit testing, code deployment
  • Self starter to be able to grasp new concepts and technology and translate them into large scale engineering developments
  • Excellent experience in Application development and support, integration development and data management.
Align the company with key Client initiatives:
  • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements.
  • Stay up-to-date on the latest technology to ensure the greatest ROI for customer & the company
  • Hands on coder with good understanding on enterprise level code.
  • Design and implement APIs , abstractions and integration patterns to solve challenging distributed computing problems.
  • Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing be a strategic thinker with the ability to think unconventional / out:of:box.
  • Analytical and data driven orientation.
  • Raw intellect, talent and energy are critical.
Entrepreneurial and Agile :
  • Understands the demands of a private, high growth company.
  • Ability to be both a leader and hands on "doer".
Ideal Candidate:
  • Years of track record of relevant work experience and a computer Science or related technical discipline is required.
  • Experience with functional and object-oriented programming, Java or Python is a must .
  • Hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch .
  • Effective communication skills (both written and verbal).
  • Ability to collaborate with a diverse set of engineers, data scientists and product managers.
  • Comfort in a fast-paced start-up environment.
Preferred Qualification:
  • Technical knowledge in Map Reduce, Hadoop & GCS Stack a plus.
  • Experience in agile methodology.
  • Experience with database modeling and development, data mining and warehousing.
  • Experience in architecture and delivery of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, propose comprehensive solutions and guide junior staff.
  • Experience working with large, complex data sets from a variety of sources.

(ref:hirist.tech)

  • Big Data Engineer

    4 weeks ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, India TechSophy Full time

    Job Description:Roles&Responsibilities :1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map.2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into the data...

  • Big Data Engineer

    4 weeks ago

    hyderabad, India TechSophy Full time

    Job Description: Roles&Responsibilities : 1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map.2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, India TechSophy Full time

    Job Description: Roles&Responsibilities : 1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map. 2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into...

  • Big Data Platform Engineer

    4 weeks ago

    hyderabad, India Apple Full time

    Summary:The people here at Apple don’t just build products — we craft the kind of wonder that’s revolutionized entire industries. It’s the diversity of those people and their ideas that supports the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Join Apple, and help us leave the world...

  • Big Data Developer

    1 week ago

    hyderabad, India Talentgigs Full time

    Role: Big Data Engineer.Experience: 7 Years.Location: Hyderabad(HYBRID).NP: Immediate - 15 DaysMandatory skills: GCP - Cloud - Big Data Engineer, Apache Airflow, Apache Spark, Scala .Job Description:Key Responsibilities:● Design, develop, and maintain Big Data pipelines, ensuring data quality, reliability, and scalability.● Utilize Apache Spark and...

  • Big Data Developer

    4 weeks ago

    Bangalore Metropolitan Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big data lead engineer

    3 days ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 DescriptionPosition: Big data engineerPrimary skills: Big data, Pyspark, AWSLocation: HYDCreate Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data bridge APIData...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big data lead engineer

    1 week ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data...

  • Big data lead engineer

    1 week ago

    hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data...

  • Big Data Engineer

    4 weeks ago

    bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Developer

    2 weeks ago

    hyderabad, India Talentgigs Full time

    Role: Big Data Engineer. Experience: 7 Years. Location: Hyderabad(HYBRID). NP: Immediate - 15 Days Mandatory skills: GCP - Cloud - Big Data Engineer, Apache Airflow, Apache Spark, Scala . Job Description: Key Responsibilities: ● Design, develop, and maintain Big Data pipelines, ensuring data quality, reliability, and scalability. ● Utilize Apache...

  • Big Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...

  • Big Data Engineer

    2 weeks ago

    Bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    3 weeks ago

    Hyderabad, India Anicalls (Pty) Ltd Full time

    Big Data EngineerSpecification-• 2 – 7 years of recent experience indata engineering.• Bachelor's Degree or more in ComputerScience or a related field.• A solid track record of data management showing your flawless executionand attention to detail.• Strong knowledge of and experience with statistics.• Programming experience, ideally in , Spark,...

  • Big Data Engineer

    3 hours ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 14, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    4 weeks ago

    hyderabad, India Anicalls (Pty) Ltd Full time

    Big Data Engineer  Specification- • 2 – 7 years of recent experience indata engineering. • Bachelor's Degree or more in ComputerScience or a related field. • A solid track record of data management showing your flawless executionand attention to detail.• Strong knowledge of and experience with statistics.• Programming experience, ideally in ,...

  • Aws big data engineer

    4 weeks ago

    bangalore, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...