Big Data Engineer

6 days ago


India Taiyō.AI Full time

We empower the people who build the world.


Taiyō.AI is the world's largest infrastructure construction data-mesh technology and the first AI platform for the global infrastructure construction industry. Our clients include some of the largest construction firms, suppliers, and government.


About The Team

We are looking for Big Data Engineer to help support and lead our data engineering ops.


Your Key Responsibilities

Developing and executing processes for monitoring data sanity, check for data availability and reliability.

Understanding the business drivers and building insights through data.

Partner with stakeholders at all levels to establish current and ongoing data support and reporting needs.

Ensure continuous data accuracy and recognize data discrepancies in systems that require immediate attention/escalation.

Become expert in the company’s data warehouse and other data storage tools, understanding the definition, context, and proper use of all attributes and metrics.

Creating dashboards based on business requirements.

Distributed systems, Scala, cloud, Caching, CI/CD (Continuous integration and deployment), Distributed logging, Data pipeline, Recommendation Engine, Data at Rest Encryption


What To Bring

Graduate/Post Graduate degree in Computer Science or Engineering.

1-3 years of Hands on experience with AWS open search v1.0 or elastic search 7.9

3+ years of work experience on Scala

Must be able to drive, design, code, review the work, assist the teams

Good problem solving skills

Good oral and written communication in English

Should be open to / have experience of working in fast paced delivery environment

Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.

Good To have experience on Elasticsearch and Spark-Elasticsearch

Knowledge of Garbage Collection, and experience in GC tuning.

Knowledge of algorithms like sorting, heap/stack, queue, search, etc.

Experience with Git and build tools like Gradle/Maven/SBT

Should be able to write complex queries independently.

Strong knowledge of programming languages like Python, Scala etc.

Ability to work independently and take ownership of things.

Analytical mindset and strong attention to detail.

Good verbal & written communication skills for coordinating across teams.


  • Big Data Engineer

    3 weeks ago


    india Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Big Data Engineer

    1 week ago


    India Careerfit Full time

    Job Title: Big Data Solutions EngineerAbout the Company: Our company is a leading tech firm specializing in innovative data solutions that empower businesses to make informed decisions.Responsibilities :Solution Design : Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and...


  • India Grownex HR Solution Full time

    Role : Lead Big Data Engineer Work Mode : Remote(5 Days working) The Opportunity - Development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate...


  • India Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients. The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • Big Data Engineer

    2 weeks ago


    india Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Duration:  6 MonthLocation:  RemoteTimings: Full Time (As per company timings)Notice Period: within 15 days or immediate joinerExperience: 4-6 Years   Responsibilities Create and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial...

  • Big Data Engineer

    1 week ago


    India ATech Full time

    Designation:BIG DATA ENGINEERJob Description:Your Role and Responsibilities: Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Design, build, optimize and support new and existing data models and ETL processes based on our clients...

  • Big Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations D-TechWorks Pvt Ltd Full time

    We are hiring for Big Data AI/ML Engineer - Remote , India Position : Big Data AI/ML EngineerExperience : 6 to 9 YrsLocation : Remote We are seeking a talented Data Engineer with AI & ML knowledge to join our team. As Data Engineer or ML Ops Engineer, your primary responsibility will be to develop & integrate ML solutions that focus on technology...

  • Data Engineer

    3 weeks ago


    india Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Role: Data Engineer  Experience: 2+Years Notice period: Immediate Location: Anywhere from India Job Type: Full Time Responsibilities: Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations &...

  • Data Engineer

    1 month ago


    india Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Role: Data Engineer  Experience: 2+Years Notice period: Immediate Location: Anywhere from India Job Type: Full Time Responsibilities: Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations &...

  • Big Data Architect

    1 week ago


    India ARR Recruitment Solutions Full time

    About the Role : We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions. This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :...

  • Big Data Engineer

    5 days ago


    india Programming.com Full time

    Job Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...


  • india IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...


  • India IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...


  • India IKAI Technology Solutions Full time

    We are seeking a talented Big Data + GCP Engineer to join our dynamic team. In this role, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will collaborate closely with cross-functional teams to ensure that our data platform meets the needs of our business...

  • Big Data Architect

    1 week ago


    India Swift Strategic Staff Solutions INC Full time

    Responsibilities :Data Ingestion & Processing : Design and build robust data pipelines using tools like Apache Spark, Flink, or Kafka to ingest, transform, and process massive datasets from various sources.Big Data Technologies : Utilize your expertise in big data frameworks like Hadoop, YARN, and HDFS to manage, store, and analyze large volumes of data...


  • India Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...


  • india TechTiv Software Solutions Full time

    The Opportunity : Digit88 development team is establishing a new offshore product development team for its partner , that is building next-generation Big Data, Cloud-Based Business Operation Support technology for utilities, retail energy suppliers and Community Choice Aggregators (CCA). The candidate would be joining an existing team of outstanding data...


  • India Leading MNC Full time

    Looking for a Freelance Big Data Solutions Engineer to join a team of rockstar developers. The candidate should have a minimum of 4+experience. There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report...

  • Big Data Engineer

    7 days ago


    india Taiyō.AI Full time

    We empower the people who build the world. Taiyō.AI is the world's largest infrastructure construction data-mesh technology and the first AI platform for the global infrastructure construction industry. Our clients include some of the largest construction firms, suppliers, and government. About The Team We are looking for Big Data Engineer to help support...

  • Data Engineer –

    3 weeks ago


    india HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...