Big Data Engineer

3 weeks ago


india Awign Expert Full time
Job Description

This is a remote position.

Job Title: Big Data Solutions Engineer

Reporting to: Director, Product Management

Location: India (Remote)

Our Ideal Candidate
Our company is seeking a talented Big Data Solutions Engineer to join our team.
The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients. The candidate will work closely with the software development team, data scientists, and product managers to understand requirements, configure and implement our Fin Crime solution. The responsibilities of the candidate will
be as follows –
Responsibilities:
• Create and maintain data pipelines that transfer data from select location (maintaining security protocols) into our Big Data financial crime solution.
• Develop, implement, and standardise ETL processes to transform and cleanse data for pipeline development and reporting.
• Develop and implement data models and schemas to support analytical applications and data visualization tools.
• Monitor and troubleshoot issues with our proprietary Big Data financial crime solution and provide timely resolution.
• Develop and implement security and data privacy measures to protect sensitive data.
• Develop and maintain documentation and training materials for end-users and stakeholders.
• Keep up to date with emerging trends and technologies in Big Data, data analytics, and data engineering.
Requirements:
• Bachelor’s degree in computer science, Engineering, or related field
• 4+ years of experience in designing, configuring, and implementing Big Data solutions, preferably with financial crime solutions.
• Strong programming skills in Java, Python, or Scala.
• Strong understanding of data modelling, data warehousing, and ETL processes.
• Strong understanding of Big Data technologies and their architectures, including Hadoop, Spark, and NoSQL databases.
• Strong analytical and problem-solving skills.
• Excellent communication and interpersonal skills.
• Ability to work in a fast-paced, team-oriented environment.
• Ability to manage multiple priorities and deadlines.
• Experience with AWS is a plus.
Compensation & Job Perks 
• Opportunity to build AI and Analytics products for Global Markets
• Opportunity to innovate, Learn and Grow
• Attractive variable compensation package
• Flexible working hours - everything is results-oriented
• Opportunity to work with an award-winning organization in the hottest space in tech - artificial intelligence and advanced machine learning.
Important Note: Big Data Solutions Engineer - This role isn't anything fancy; we're seeking a Data Engineer with experience in Python, PySpark, ES, MySQL, ETL, and Unix. Specifically, we're not interested in cloud-native data engineers but rather individuals with experience in open-source technologies.

The duration of this role is 6 months, and the location will be Bangalore. We aim to have these individuals in Bangalore for a hybrid work setup starting from October 2024.
For the interview process, we plan to conduct 3 rounds of video interviews. We will primarily evaluate candidates based on their technical skills, communication abilities, and experience working closely with customers.
Requirements
Python, PySpark, ES, MySQL, ETL, and Unix
  • Big Data Engineer

    6 days ago


    India Careerfit Full time

    Job Title: Big Data Solutions EngineerAbout the Company: Our company is a leading tech firm specializing in innovative data solutions that empower businesses to make informed decisions.Responsibilities :Solution Design : Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and...


  • India Grownex HR Solution Full time

    Role : Lead Big Data Engineer Work Mode : Remote(5 Days working) The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate...


  • India Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients. The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • Big Data Engineer

    2 weeks ago


    india Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Duration:  6 MonthLocation:  RemoteTimings: Full Time (As per company timings)Notice Period: within 15 days or immediate joinerExperience: 4-6 Years   Responsibilities Create and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial...

  • Big Data Engineer

    6 days ago


    India ATech Full time

    Designation:BIG DATA ENGINEERJob Description:Your Role and Responsibilities: Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Design, build, optimize and support new and existing data models and ETL processes based on our clients...

  • Big Data Engineer

    6 days ago


    Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full time

    We are hiring for Big Data AI/ML Engineer - Remote , India Position : Big Data AI/ML EngineerExperience : 6 to 9 YrsLocation : Remote We are seeking a talented Data Engineer with AI & ML knowledge to join our team. As Data Engineer or ML Ops Engineer, your primary responsibility will be to develop & integrate ML solutions that focus on technology...

  • Data Engineer

    3 weeks ago


    india Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Role: Data Engineer  Experience: 2+Years Notice period: Immediate Location: Anywhere from India Job Type: Full Time Responsibilities: Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations &...

  • Data Engineer

    1 month ago


    india Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Role: Data Engineer  Experience: 2+Years Notice period: Immediate Location: Anywhere from India Job Type: Full Time Responsibilities: Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations &...

  • Big Data Architect

    6 days ago


    India ARR Recruitment Solutions Full time

    About the Role : We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions. This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :...

  • Big Data Engineer

    2 days ago


    india Programming.com Full time

    Job Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...


  • India IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...


  • India IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...


  • india IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...


  • India Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...

  • Big Data Architect

    6 days ago


    India Swift Strategic Staff Solutions INC Full time

    Responsibilities :Data Ingestion & Processing : Design and build robust data pipelines using tools like Apache Spark, Flink, or Kafka to ingest, transform, and process massive datasets from various sources.Big Data Technologies : Utilize your expertise in big data frameworks like Hadoop, YARN, and HDFS to manage, store, and analyze large volumes of data...


  • India Leading MNC Full time

    Looking for a Freelance Big Data Solutions Engineer to join a team of rockstar developers. The candidate should have a minimum of 4+experience. There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report...

  • Data Engineer –

    3 weeks ago


    india HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Data Engineer –

    2 months ago


    india HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Big Data Engineer

    4 days ago


    india Taiyō.AI Full time

    We empower the people who build the world. Taiyō.AI is the world's largest infrastructure construction data-mesh technology and the first AI platform for the global infrastructure construction industry. Our clients include some of the largest construction firms, suppliers, and government. About The Team We are looking for Big Data Engineer to help support...

  • Big Data Engineer

    4 days ago


    India Taiyō.AI Full time

    We empower the people who build the world.Taiyō.AI is the world's largest infrastructure construction data-mesh technology and the first AI platform for the global infrastructure construction industry. Our clients include some of the largest construction firms, suppliers, and government. About The TeamWe are looking for Big Data Engineer to help support and...