Big Data Engineer

1 month ago


HyderabadChennaiKolkata, India Risk Resources LLP Full time

Job Title: Big Data Engineer

Job Summary:

We are seeking a highly skilled Big Data Engineer to join our team at Risk Resources LLP. The ideal candidate will have expertise in designing and implementing Big Data pipelines using PySpark, database migration, transformation, and integration solutions for Data warehousing projects.

Key Responsibilities:

- Develop data processing tasks using PySpark, including reading data from external sources, merging data, aggregating data, performing data enrichment, and loading into target data destinations.

- Collaborate with cross-functional teams to design and implement data pipelines, ensuring data quality and integrity.

- Troubleshoot performance issues and fine-tune data processing tasks to optimize performance.

- Experience with source code control systems like Git, GitHub, SVN, and deployment and operationalizing code, knowledge of scheduling tools like Control-M is preferred.

- Excellent communication and interpersonal skills, with the ability to work effectively in a team environment.

Requirements:

- 3-6 years of experience in Big Data engineering, with a strong focus on PySpark and Python programming.

- Excellent knowledge of Apache Spark and Unix/Linux Shell Scripting.

- Experience with Agile methodologies and CI/CD tools like Jenkins, Nexus, Ansible.

- Strong problem-solving skills, with the ability to troubleshoot complex data processing issues.

What We Offer:

- Competitive salary and benefits package.

- Opportunities for professional growth and development.

- Collaborative and dynamic work environment.


  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India data Full time

    Overview: We're seeking a skilled Big Data Engineer to join our team at data.ai. As a key member of our engineering team, you will be responsible for designing and implementing innovative data solutions that drive business growth. If you're passionate about working with large data sets, have experience with big data technologies, and are eager to...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Data EngineerJob Summary:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data systems. The ideal candidate will have expertise in big data ecosystems, data processing, and data storage.Key Responsibilities:Design and develop scalable data systems for business applications.Work closely with data scientists to...


  • Hyderabad, Telangana, India data Full time

    Unlock the Power of Data with UsWe're seeking an experienced Big Data Engineer to join our team and contribute to the development of innovative analytics and data products. As a key member of our engineering team, you will work closely with Data Scientists, Data Engineers, Product Managers, and Software Architects to design and implement complex data product...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India NTT DATA Services Full time

    Data Engineer RoleData engineers at NTT DATA Services are responsible for building and testing scalable Big Data ecosystems for our clients. They work closely with data scientists to ensure the source data is aggregated and cleansed, and with product managers to understand the business objectives. Data engineers must have expertise in all phases of data...

  • Big Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India ZF Group Full time

    Job Title: Big Data DeveloperJob Summary:At ZF Group, we are searching for a skilled Big Data Developer to contribute to the success of our organization. Responsibilities:- Demonstrable experience as a Big Data Developer, Data Engineer, or similar role with a minimum of 5 years in Big Data technologies and platforms.- Strong understanding of distributed...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India ANB IT Solutions Pvt Ltd Full time

    Key ResponsibilitiesCollaborate with cross-functional teams to design, develop, and maintain big data solutions using Google Cloud Big Query. Key responsibilities include data ingestion, transformation, and analytics.Data Engineering and DevelopmentDevelop and maintain ETL/ELT processes to ensure data integrity and consistency. Utilize Google Cloud Composer,...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Big Data EngineerJob Summary: We are seeking a skilled Big Data Engineer to design and implement data processing pipelines using Python and big data technologies such as Hadoop, MapReduce, Hive, and Spark.Key Responsibilities:Design and implement data processing pipelines using Python and big data technologies.Develop and maintain data assets...

  • Big Data Engineer

    2 hours ago


    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    We are seeking an experienced Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd.**Salary:** ₹15,00,000 - ₹25,00,000 per annumAs a Big Data Engineer, you will be responsible for designing and developing scalable data pipelines using Pyspark on Hadoop, Hive, and Kafka.**Required Skills and Qualifications: 4+ years of experience in Big...

  • Big Data Engineer

    2 months ago


    Hyderabad, India NucleusTeq Full time

    Big Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...

  • Big Data Engineer

    4 weeks ago


    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    About the Role:Vidpro Consultancy Services is seeking a highly skilled Big Data Engineer to join our team. As a key member of our data architecture team, you will be responsible for designing and implementing large-scale Big Data architectures using Java and Python.Key Responsibilities:Design and implement Big Data architectures using Hadoop and SparkDevelop...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India TechSophy Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at TechSophy. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Analyze large data sets to identify errors in the map.Design and implement complex...

  • Big Data Engineer

    1 month ago


    Hyderabad, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full time

    Job Title: Big Data EngineerAs a Big Data Engineer at TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD, you will be responsible for designing and developing big data solutions that drive business growth and innovation.Key Responsibilities:Design and develop big data pipelines for data ingestion and transformation using Java, Scala, or Python.Partner with domain...

  • Big Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    We are seeking a skilled Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd.The ideal candidate will have experience with Big Data technologies, including Hadoop, Hive, and Spark.Responsibilities will include:Designing and implementing Big Data solutions using Hadoop, Hive, and Spark.Developing and maintaining large-scale data processing...

  • Big data engineer

    5 months ago


    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...

  • Big Data Engineer

    1 month ago


    hyderabad, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Job Summary:We are seeking a skilled and innovative Big Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems. You will work with large datasets and implement data pipelines to ensure data quality and availability for analytics and business intelligence...

  • Big data engineer

    1 month ago


    Hyderabad, India RiDiK Full time

    Job Summary: We are seeking a skilled and innovative Big Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems. You will work with large datasets and implement data pipelines to ensure data quality and availability for analytics and business intelligence...

  • Big Data Engineer

    4 weeks ago


    Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full time

    Job Title: Senior Scala Developer for Big DataLocation: Type: Full-TimeJob Overview:We are seeking a highly skilled Senior Scala Developer for Big Data to lead our team in designing, developing, and optimizing data processing pipelines using Apache Spark. The ideal candidate will have a deep understanding of big data technologies and strong programming...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...

  • Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    Job Title: Data Engineer - Big Data ArchitectureJob Summary:We are seeking a highly skilled Data Engineer to design, develop, and deploy scalable Big Data applications using Apache Spark.The successful candidate will collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.The Data Engineer...

  • Big Data Engineer

    1 month ago


    Hyderabad, Telangana, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full time

    Job SummaryWe are seeking a highly skilled and innovative Big Data Engineer to join our dynamic team at RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS). The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems that support analytics and machine learning initiatives.Key ResponsibilitiesDesign and implement...