Big Data Engineer

4 weeks ago

BangaloreHyderabad, India VIDPRO CONSULTANCY SERVICES Full time

About the job:

- This position will be part of a growing team working towards building world class large scale Big Data architectures.

- This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding.

Location - Bangalore and Hyderabad

Work Experience : 2 - 5 Years

Mandatory Skills:

- Python or Java


- Spark, SQL, Snowflake, Hadoop(optional), Airflow, Data structures and algorithms

- GCP cloud knowledge like Google Storage, Google Dataproc, Google Pub- Sub, Google Big Good development practices

- Hands on coder with good experience in programming languages like Java, Python, C++ or Scala.

- Good understanding of programming principles and development practices like checkin policy, unit testing, code deployment

- Self starter to be able to grasp new concepts and technology and translate them into large scale engineering developments

- Excellent experience in Application development and support, integration development and data management.

- Align with key Client initiatives

- Interface daily with customers across leading Fortune 500 companies to understand strategic requirements

- Stay up-to-date on the latest technology to ensure the greatest ROI for customer

- Hands on coder with good understanding on enterprise level code

- Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems

- Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment

Culture:

- Must be a strategic thinker with the ability to think unconventional / out:of:box.

- Analytical and data driven orientation.

- Raw intellect, talent and energy are critical.

- Entrepreneurial and Agile : understands the demands of a private, high growth company.

- Ability to be both a leader and hands on "doer".

Qualifications:

- Years of track record of relevant work experience and a computer Science or related technical discipline is required

- Experience with functional and object-oriented programming, Python or Scala a must

- Effective communication skills (both written and verbal)

- Ability to collaborate with a diverse set of engineers, data scientists and product managers

- Comfort in a fast-paced start-up environment .

Preferred Qualification:

- Technical knowledge in Spark, Hadoop & GCS Stack.

- Vertica, Snowflake, Druid a plus

- Development and support experience in Big Data domain

- Experience in agile methodology

- Experience with database modeling and development, data mining and warehousing.

- Experience in architecture and delivery of Enterprise scale applications and capable in developing framework, design patterns etc.

- Should be able to understand and tackle technical challenges, propose comprehensive solutions and guide junior staff

- Experience working with large, complex data sets from a variety of sources

Skills: python,data structures,big data,hadoop,snowflake,apache spark,mysql,google cloud platform,java,airflow,google cloud,data mining,data warehouse,data architecture

(ref:hirist.tech)

  • Big Data Engineer

    2 days ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Big Data Engineer

    1 month ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, India TechSophy Full time

    Job Description:Roles&Responsibilities :1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map.2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into the data...

  • Big Data Engineer

    1 month ago

    Hyderabad, India TechSophy Full time

    Job Description: Roles&Responsibilities : 1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map. 2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into...

  • Big Data Engineer

    1 month ago

    hyderabad, India TechSophy Full time

    Job Description: Roles&Responsibilities : 1. As an Engineer, you are responsible to analyze large data sets to identify errors in the map.2. As an Engineer, you are responsible to design and implement a complex algorithm for resolving the issue, review the solution with a team of engineers and analysts, and integrate the resulting solution into...

  • Big Data Platform Engineer

    1 month ago

    hyderabad, India Apple Full time

    Summary:The people here at Apple don’t just build products — we craft the kind of wonder that’s revolutionized entire industries. It’s the diversity of those people and their ideas that supports the innovation that runs through everything we do, from amazing technology to industry-leading environmental efforts. Join Apple, and help us leave the world...

  • Big Data Engineer

    1 month ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big data lead engineer

    7 days ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 DescriptionPosition: Big data engineerPrimary skills: Big data, Pyspark, AWSLocation: HYDCreate Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data bridge APIData...

  • Big data lead engineer

    2 weeks ago

    hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data MigrationIdentify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the sameIntegrate CDMS framework with Lake and Data...

  • Big data lead engineer

    2 weeks ago

    Hyderabad, India Virtusa Full time

    Big data lead engineer - CREQ188245 Description Position: Big data engineer Primary skills: Big data, Pyspark, AWS Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data...

  • Big Data Engineer

    1 month ago

    bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...

  • Big Data Engineer

    2 weeks ago

    Bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, India Anicalls (Pty) Ltd Full time

    Big Data EngineerSpecification-• 2 – 7 years of recent experience indata engineering.• Bachelor's Degree or more in ComputerScience or a related field.• A solid track record of data management showing your flawless executionand attention to detail.• Strong knowledge of and experience with statistics.• Programming experience, ideally in , Spark,...

  • Big Data Engineer

    4 days ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 14, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    2 days ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 16, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Big Data Engineer

    1 month ago

    hyderabad, India Anicalls (Pty) Ltd Full time

    Big Data Engineer  Specification- • 2 – 7 years of recent experience indata engineering. • Bachelor's Degree or more in ComputerScience or a related field. • A solid track record of data management showing your flawless executionand attention to detail.• Strong knowledge of and experience with statistics.• Programming experience, ideally in ,...

  • Aws big data engineer

    1 month ago

    bangalore, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Senior Data Engineer

    1 month ago

    Bangalore, India Muoro Full time

    Job Description : About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions...