Big Data Developer

4 weeks ago


GurgaonGurugram, IN Rocket Consulting Full time

Big Data Engineer

Position Overview :

We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data warehouses, and analytical systems to support our organization's data-driven initiatives.

Key Responsibilities :

- Design, develop, and deploy scalable and reliable data pipelines to ingest, process, and analyze large volumes of structured and unstructured data.

- Implement data processing solutions using distributed computing frameworks such as Apache Hadoop, Apache Spark, or Apache Flink.

- Develop and maintain ETL (Extract, Transform, Load) processes to ensure data quality and consistency across multiple sources and platforms.

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into technical solutions.

- Optimize and tune data processing workflows for performance, scalability, and efficiency.

- Implement data security and governance best practices to ensure compliance with regulatory requirements and protect sensitive data.

- Monitor and troubleshoot data pipelines and systems, identifying and resolving issues in a timely manner.

- Stay updated with the latest technologies and trends in big data and distributed computing, evaluating and recommending new tools and frameworks as needed.

- Document design decisions, technical specifications, and operational procedures for reference and knowledge sharing.

- Provide technical guidance and mentorship to junior members of the team, fostering a culture of learning and innovation.

Qualifications :

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- Proven experience as a Big Data Engineer or similar role, with a focus on designing and implementing data processing systems.

- Proficiency in programming languages such as Java, Scala, or Python, with experience in big data frameworks and tools (e.g., Hadoop, Spark).

- Strong understanding of distributed computing principles and concepts, including parallel processing, data partitioning, and fault tolerance.

- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform for deploying and managing big data infrastructure.

- Knowledge of SQL and NoSQL databases for data storage and retrieval.

- Familiarity with data warehousing concepts and technologies (e.g., Apache Hive, Apache HBase, Amazon Redshift).

- Excellent problem-solving and analytical skills, with attention to detail.

- Effective communication and collaboration skills, with the ability to work in a team environment.

- Commitment to continuous learning and self-improvement in the field of big data and distributed computing.

(ref:hirist.tech)

  • Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

  • Big Data Developer

    4 weeks ago


    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...


  • Gurgaon/Gurugram, IN Paisabazaar.com Full time

    Job Description :Qualifications for Data Engineer :3+ Years of experience in building and optimizing 'big data' solutions required to fulfill business and technology requirements.3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.Strong analytic skills to understand and...

  • Solution Architect

    4 weeks ago


    Bangalore/Gurgaon/Gurugram/Chandigarh, IN USEReady Technology Pvt. Ltd. Full time

    Job Title : Solutions Architect (Data & BI)Job Description : Solutions Architect (Data & BI) with around 10 - 15 years of experience in the following areas,Mandatory Skills :- Tableau, Big Data, Hadoop, Data Warehousing, Legacy BI Migrations, Cloud technologies.- Experienced in BI Implementation, BI migration involving Tableau.Preferred Skills : Starburst,...


  • Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Qualifications :- 3.5-7 years of IT experience range is preferred.- The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.- Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.- Exposure to enterprise application...

  • Big Data Developer

    4 weeks ago


    Bangalore/Hyderabad/Noida/Gurgaon/Gurugram/Indore, IN ARR Recruitment Solutions Full time

    Requirement :- Solid Experience of software development experience and leading teams of engineers and scrum teams.- 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and Java).- Solid Data warehousing concepts.- Knowledge of Financial reporting ecosystem will be a plus.- 4+ years of experience within Data Engineering/ Data...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN Huquo Consulting Full time

    Role : Data EngineerLocation : GurgaonDesignation : AM- AVP (as per interview performance & EXL fitment)Work Timings : 1pm- 10pmRole Overview :We are looking for a go getter person who can define :1. Analytic strategies to meet the demands of business requirements2. Technical requirements of the analytic solutions3. Data requirements of the analytic solution...

  • Big Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Big Data Engineer Must-Have :- 5+ years of experience in Software and IT industry - 3 + years of relevant work experience in data engineering- Hands on in Python/Scala data engineering application development - Hands on in developing streaming application.- Knowledge on Test automation and scripting - Experience with CI/CD process and tools (GIT, Jenkins,...

  • AWS Data Architect

    4 weeks ago


    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...


  • Gurgaon/Gurugram, IN Huquo Full time

    Job Description :- Analytic strategies to meet the demands of business requirements- Technical requirements of the analytic solutions- Data requirements of the analytic solution processes- The person will be part of the Data Science team for a major Insurance client. He/ She will work with different stakeholders as SME for data engineering- Engages in...

  • Big Data Developer

    4 weeks ago


    Bangalore/Gurgaon/Gurugram/Pune/Chennai/Coimbatore/Mumbai/Cochin/Kochi/Noida, IN SP Software Pvt. Ltd. Full time

    Job Description :- Should have hands on experience in Software development- Responsible for designing, deploying, and managing high quality data solutions in the AWS cloud ecosystem.- Create and maintain optimal data architecture pipeline.- Collaborate with various onsite and client stakeholders in Agile environment to identify data engineering requirements...

  • Curate Data Analytics

    4 weeks ago


    Gurgaon/Gurugram, IN Curate Data Analytics LLP Full time

    About the Job : Senior Power BI DeveloperWe at Curate Data Analytics (A Startup in Business Analytics & Strategy space) are on a look out for a dynamic leader who knows Power BI very well, to be part of our Business Intelligence reporting Team. The incumbent is required to have a good understanding of business analytics & reporting using Power BI in FMCG...

  • Data Engineer

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...


  • Gurgaon/Gurugram, IN COFORGE Full time

    Job Description :As a Senior Data Engineer, you'll be at the forefront of developing and optimizing data pipelines, ensuring the seamless flow of data across our systems. Bring your expertise in Java, Python, and a range of big data technologies including Hadoop, Cassandra, Kafka, Spark, HBase, and MySQL to drive innovation and efficiency in our data...


  • Gurgaon/Gurugram, IN Bigfoot Retail Solutions Pvt. Ltd Full time

    Job Description :- Design and build data pipelines from various cloud data sources for the enterprise data warehouse- Partner with Data Engineers, Data architects, domain experts, data analysts and other teams to build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service- Own and document data...

  • Senior Manager

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Senior Manager - Banking (sas/sql, python/R, tableau/power bi) :- Design, build and deploy advance analytics models aimed to improve fraud risk strategies of clients using Hadoop technology stacks and programming languages such as Hive, PySpark, Python, Spark & shell- Design, build and deploy an anomaly detection tool to identify suspicious transaction...

  • Publicis Sapient

    4 weeks ago


    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • PySpark Developer

    4 weeks ago


    Gurgaon/Gurugram, IN Waytogo Consultants Full time

    Responsibilities :Design and develop PySpark applications using Spark DataFrames and SQL to extract, transform, and load (ETL) data.Read data from various sources such as relational databases, data lakes, and cloud storage using PySpark connectors.Clean, transform, and enrich data using PySpark functions for data wrangling and manipulation.Build and maintain...

  • Data Engineer

    2 weeks ago


    Gurgaon/Gurugram, IN Impetus Technologies India Pvt. Ltd Full time

    Job Description :4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies - Hadoop, Sqoop, Hive and Spark...

  • Data Modeller

    4 weeks ago


    Gurgaon/Gurugram, IN HuQuo Consulting Pvt. Ltd. Full time

    Education & Experience - 7-10 Years industry implementation experience with one or more data modelling tools such as Erwin, ERStudio, PowerDesigner etc. - Minimum of 8 years of data architecture, data modelling or similar experience - 5-7 years of management experience required - 5-7 years consulting experience preferred - Experience working with...