Big Data Engineer

4 weeks ago

Bangalore Urban, India Algonomy Full time

Role : Big Data Engineer

Years of experience : 5-8 years

Location : Bangalore


At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.


We aim to become the algorithmic bridge between consumers and brands/retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algonomy signifies an expertise in algorithms. As technology evolves our lives (and our clients’) at hyper-speed, Algonomy stands as a bold, creative and agile brand; and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry’s needs


We are seeking an experienced Big Data Engineer with a minimum of 5 years of relevant experience to join our team to contribute to the development and maintenance of a robust data lake infrastructure on AWS and Azure platforms. The ideal candidate will possess in-depth expertise in big data technologies, data lake architecture, and cloud services, particularly AWS and Azure.


Key Responsibilities:

Design, architect, and build data lake solutions on AWS and Azure environments, ensuring scalability, availability, and security of data.

Collaborate with cross-functional teams to understand data requirements, and implement data ingestion, processing, and storage solutions within the data lake framework.

Optimize and tune data lake performance, implement data governance, and ensure data quality and consistency.

Develop Extract, Transform, Load (ETL) processes, implement data pipelines, and orchestrate data workflows to support analytics and reporting needs.

Conduct performance monitoring, troubleshooting, and capacity planning for the data lake infrastructure.

Stay up-to-date with emerging technologies and best practices in big data, data lake, and cloud computing, and provide recommendations for continuous improvement.


Minimum Requirements:

Bachelor’s degree in Computer Science, Engineering, or a related field.

Minimum of 5 years of professional experience in big data engineering, data lake development, and cloud platforms (specifically AWS and Azure).

Proficiency in big data technologies such as Hadoop, Spark, Hive, and related ecosystem tools.

Hands-on experience with cloud services including Amazon S3, Amazon EMR, Amazon Redshift , AWS Athen , Azure Data Lake Storage, Azure HDInsight, Azure Synapse and related data services.

Strong programming skills in languages such as SQL,Python, Scala, or Java for data processing and transformation.

Knowledge of data warehousing concepts, data profile, data modeling, and database technologies.

Experience with DevOps practices, containerization, and infrastructure as code tools (e.g., Docker, Kubernetes, Terraform) is a plus.

Excellent problem-solving abilities, strong analytical skills, and the ability to work effectively in a team environment.

We offer a collaborative and innovative work environment with opportunities for professional growth and development. If you are passionate about building scalable, high-performance data lake solutions and thrive in a dynamic, fast-paced environment, we encourage you to apply and join our team.


ABOUT ALGONOMY

Algonomy (previously Manthan-Rich Relevance) empowers leading brands to become digital-first with the industry’s only real-time Algorithmic Customer Engagement (ACE) platform with built-in customer activation and analytics for the retail industry. With industry-leading retail AI expertise connecting demand to supply with a real-time customer data platform as the foundation, Algonomy enables 1:1 omnichannel personalization, customer journey orchestration & analytics, merchandising analytics and supplier collaboration. Algonomy is a trusted partner to more than 400 leading retailers, consumer brands, quick serve restaurant chains, convenience stores and more, and our global presence spans over 20 countries. More at

  • Big Data Engineer

    4 weeks ago

    bangalore, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, Ansible Job DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Developer

    1 week ago

    Bangalore Urban, India HTC Global Services Full time

    About HTC Global ServicesHTC Global Services is a US based IT solutions and IT enabled services company with its global headquarters in Troy, MI. We are an Inc 500 Hall of Fame company with our existence in the industry for three decades. HTC is a SEI-CMM Level 5 and ISO 9001 & ISO 27001 certified organization. HTC has its global presence in North America,...

  • Big Data Engineer

    4 weeks ago

    bangalore, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with...

  • Big Data Developer

    4 weeks ago

    Bangalore Metropolitan Area, India Aptus Data Labs Full time

    Job Title: Big Data Developers Experience: Minimum 8 yearsLocation: Remote / core location - BangaloreMandatory Skills (Hadoop , Hive, HiveQL , Cloudera , ETL, Pyspark/Python, Shell Scripting, Automation )Strong proficiency in Hadoop ecosystem including HDFS, Hive, and HSQLExtensive experience with Python and PySpark for data processing and...

  • Big Data Engineer

    4 weeks ago

    bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India TalentPulse Consultant Full time

    Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...

  • Big Data Engineer

    2 weeks ago

    Bangalore, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    2 days ago

    bangalore, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 14, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake &...

  • Aws big data engineer

    4 weeks ago

    bangalore, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India Muoro Full time

    Job Description : About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions...

  • Senior Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Big Data Architect

    4 weeks ago

    bangalore, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Big Data Developer

    3 weeks ago

    bangalore, India BigShyft Full time

    JobDescription: We are seeking askilled and experienced Big Data Developer/Data Engineer to joinour clients team in Bengaluru. The ideal candidate should have astrong background in Java Spark Hadoop and Scala with 47 years ofrelevant workexperience.Responsibilities: Designdevelop and maintain largescale data processing systems leveragingHadoop Spark and...

  • Big Data Engineer

    4 days ago

    bangalore, India TekWissen India Full time

    Role: Big Data EngineerLocation: Bangalore-OnsiteWorktype: Contract for 6 monthsPRINCIPAL RESPONSIBILITIES:- Gain core business understanding of Textron Aviation and aircraft design, operation, and support- Query, clean, transform, and stage data (ETL/ELT) across on-prem and cloud environments- Support data analytics and data science activities by...

  • Big data architect

    4 weeks ago

    bangalore, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig...

  • Senior Big Data Engineer

    4 weeks ago

    bangalore, India Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • Big Data Developer

    4 weeks ago

    bangalore, India Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...