Big Data Engineer

4 weeks ago

Bengaluru, India Algonomy Full time
Role :

Big Data EngineerYears of experience : 5-8 yearsLocation : Bangalore

At Algonomy, we believe the future of our economy is Algorithmic, where businesses will develop resilient, adaptive and agile decisioning abilities that will constantly test and refine AI-driven actions to create the best personal experience for every individual customer at scale.

We aim to become the algorithmic bridge between consumers and brands/retailers, and to lead our customers through the Algorithmic transformation imperative. The name Algonomy signifies an expertise in algorithms. As technology evolves our lives (and our clients’) at hyper-speed, Algonomy stands as a bold, creative and agile brand; and these are also the very qualities that every digital-first business needs in order to be successful in the new normal. We are ambitious, we create category leading solutions in our markets, and we are constantly learning, inventing and adapting to stay ahead of our industry’s needs

We are seeking an experienced Big Data Engineer with a minimum of 5 years of relevant experience to join our team to contribute to the development and maintenance of a robust data lake infrastructure on AWS and Azure platforms. The ideal candidate will possess in-depth expertise in big data technologies, data lake architecture, and cloud services, particularly AWS and Azure.

Key Responsibilities:Design, architect, and build data lake solutions on AWS and Azure environments, ensuring scalability, availability, and security of data.Collaborate with cross-functional teams to understand data requirements, and implement data ingestion, processing, and storage solutions within the data lake framework.Optimize and tune data lake performance, implement data governance, and ensure data quality and consistency.Develop Extract, Transform, Load (ETL) processes, implement data pipelines, and orchestrate data workflows to support analytics and reporting needs.Conduct performance monitoring, troubleshooting, and capacity planning for the data lake infrastructure.Stay up-to-date with emerging technologies and best practices in big data, data lake, and cloud computing, and provide recommendations for continuous improvement.

Minimum Requirements:Bachelor’s degree in Computer Science, Engineering, or a related field.Minimum of 5 years of professional experience in big data engineering, data lake development, and cloud platforms (specifically AWS and Azure).Proficiency in big data technologies such as Hadoop, Spark, Hive, and related ecosystem tools.Hands-on experience with cloud services including Amazon S3, Amazon EMR, Amazon Redshift , AWS Athen , Azure Data Lake Storage, Azure HDInsight, Azure Synapse and related data services.Strong programming skills in languages such as SQL,Python, Scala, or Java for data processing and transformation.Knowledge of data warehousing concepts, data profile, data modeling, and database technologies.Experience with DevOps practices, containerization, and infrastructure as code tools (e.g., Docker, Kubernetes, Terraform) is a plus.Excellent problem-solving abilities, strong analytical skills, and the ability to work effectively in a team environment.We offer a collaborative and innovative work environment with opportunities for professional growth and development. If you are passionate about building scalable, high-performance data lake solutions and thrive in a dynamic, fast-paced environment, we encourage you to apply and join our team.

ABOUT ALGONOMYAlgonomy (previously Manthan-Rich Relevance) empowers leading brands to become digital-first with the industry’s only real-time Algorithmic Customer Engagement (ACE) platform with built-in customer activation and analytics for the retail industry. With industry-leading retail AI expertise connecting demand to supply with a real-time customer data platform as the foundation, Algonomy enables 1:1 omnichannel personalization, customer journey orchestration & analytics, merchandising analytics and supplier collaboration. Algonomy is a trusted partner to more than 400 leading retailers, consumer brands, quick serve restaurant chains, convenience stores and more, and our global presence spans over 20 countries. More at

  • Big Data Engineer

    2 days ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible....

  • Big Data Engineer

    19 hours ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ188642 DescriptionLooking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible.Bachelor's...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Virtusa Full time

    Big Data Engineer - CREQ184231 Description Profile : 5-8 years IT experience with minimum 2 years in Spark and Big Data platform Experience in Big Data technologies Hadoop, HDFS, Hive, Yarn, Jenkins, AnsibleJob DescriptionResponsibilitiesSkill: Spark, ScalaLevel: Senior Software EngineerCategory: Special/NicheTenure: 1 YearMission :He (or she) is in charge...

  • Big Data Engineer

    2 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 14, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    1 day ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 16, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    1 month ago

    Bengaluru, India Hexaware Technologies Full time

    Description Data Engineer: Primary : ADF, SQL Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Hexaware Technologies Full time

    DescriptionData Engineer:Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryptionResponsibilities:•Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned.•Provide support in defining the scope and sizing of the work.•Working closely with various enterprise architects,...

  • Big Data Engineer

    4 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 14, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    3 days ago

    Bengaluru, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 16, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...

  • Big Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Adobe Full time

    JOB LEVELP50EMPLOYEE ROLEIndividual ContributorP50 (ESDEP50) Big Data Engineer What You'll Do Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, India TalentPulse Consultant Full time

    Role : Big Data EngineerJob Description :We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis.The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala.This is an active position with a high priority, offering a competitive rate and the...

  • Big Data Architect

    4 weeks ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Aws big data engineer

    4 weeks ago

    Bengaluru, India Global Pharma Tek Full time

    ob DescriptionTechnical skills. Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...

  • Aws big data engineer

    1 month ago

    Bengaluru, India Global Pharma Tek Full time

    ob Description Technical skills . Having ETL development experience with overall to years in AWS , Big data engineering related application Minimum end to end ETL project implementation Proficient in PySpark, Python. Proficient in Big Data technologies - Hadoop, Spark, Hive, Databricks. Expert in AWS to develop, deploy and maintain ETL applications using...

  • Senior Data Engineer

    1 month ago

    Bengaluru, India Muoro Full time

    Job Description :About the role :We are looking for a Senior Data Engineer to join our growing engineering team. As a member of the team:- You will work on enterprise data platforms, architect and implement data lakes both on-prem and in the cloud.- You will be responsible for evolving technical architecture, design and implementation of data solutions using...

  • Data Engineer

    2 days ago

    Bengaluru, India Evnek Technologies Pvt Ltd Full time

    Job Description This is a remote position. Role: Data Engineer  Experience: 2+Years Notice period: Immediate Location: Anywhere from India Job Type: Full Time Responsibilities: Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations &...

  • Big Data Quality Assurance Engineer

    1 month ago

    Bengaluru, India Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...

  • Big Data Architect

    1 month ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Data Engineer

    2 days ago

    Bengaluru, India Evnek Technologies Pvt Ltd Full time

    This is a remote position. Role: Data Engineer  Experience: 2+Years Notice period: Immediate Location: Anywhere from India Job Type: Full Time Responsibilities: Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations & data governance ...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...