Senior Big Data Engineer

2 days ago

Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Big Data Platform Engineer

At our organization, we are building a world-class big data platform to bring value out of data for us and for our customers.

We aim to democratize data, support exploding business, provide reporting and analytics self-service tools, and fuel existing and new business critical initiatives.

Our mission is to build scalable, available, fault-tolerant data processing systems using AWS technologies, Kafka, Spark, and other big data technologies. These systems should handle batch and real-time data processing over 100s of terabytes of data ingested every day and a petabyte-sized data warehouse.

We require an experienced software engineer who can design, develop & maintain growth data pipelines and integrate paid media sources like Facebook and Google to drive insights for business.

Key Responsibilities:

  • Architecting/designing/developing critical data pipelines at our organization.
  • Productionizing ML models in collaboration with the Data Science and Engineering teams.
  • Maintain and support existing platforms and evolve to newer technology stacks and architectures.

Requirements:

  • Excellent technical problem solving using data structures and algorithms, with emphasis on optimization and code quality.
  • 1+ years of relevant software engineering experience using object oriented programming languages like Scala / Java / Ruby / Python / C++ etc.
  • Expertise in architecting and building large-scale data processing systems using Big Data technologies like Spark, Hadoop, EMR, Kafka/ Kinesis, Flink, Druid.
  • Expertise in SQL with knowledge on any existing data warehouse technology like Redshift.

This role requires excellent communication skills, ability to work independently, and strong collaboration with cross-functional teams.

  • Big Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India beBeeBigDataEngineer Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop.Responsibilities:• Design, develop, and deploy big data solutions using Hadoop, Spark, and Scala.•...

  • Big Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Big Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Pando - Senior Data Warehousing Engineer - Big Data

    4 weeks ago

    Chennai, Tamil Nadu, India Pando Corp Private Limited Full time

    About the jobSenior Data Warehouse Engineer Pando (www.pando.ai) is pioneering the future of autonomous logistics with innovative AI capabilities. Trusted by Fortune 500 enterprises with global customers across North America, Europe, and Asia Pacific regions, we are leading the global disruption of supply chain software, with our AI-powered, no-code, &...

  • Big Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Amazon Full time

    Profit Intelligence team in Amazon Retail is seeking a seasoned and talented Senior Data Engineer to join the Historical Contribution Profit (HCP) team. HCP is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation data and Business...

  • Senior Big Data Engineer

    20 hours ago

    Chennai, Tamil Nadu, India Luxoft Full time US$ 1,04,000 - US$ 1,30,878 per year

    Project descriptionWe've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .ResponsibilitiesChoosing the right technologies for our use cases, deploy and operate.Setting up Data stores...

  • Big Data Engineering Leader

    4 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled professional to lead our data engineering initiatives. As a Big Data Engineer, you will be responsible for designing and developing large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using PySpark and HiveDevelop and maintain big data applications using Spark, HBase, and DQ...

  • Senior Big Data Python Developer

    17 hours ago

    Chennai, Tamil Nadu, India Innovatz Global Full time US$ 90,000 - US$ 1,20,000 per year

    Company DescriptionInnovatz is a Global Management Consulting, Technology Services, and Business Process Outsourcing Company headquartered in Kuala Lumpur, Malaysia. With a strong presence in America, China, India, Australia, Korea, Hong Kong, and various other countries, Innovatz has a skilled workforce of over 500, including Subject Matter Experts, Project...

  • Senior Big Data Administrator

    1 day ago

    Chennai, Tamil Nadu, India beBeeHadoop Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Administration Expert">This role is crucial for managing and optimizing our extensive Hadoop platforms, which span thousands of nodes per cluster. As a Big Data Administration expert, you will be responsible for performing comprehensive Big Data Administration and Engineering activities on multiple open-source platforms, including Hadoop, Kafka,...

  • Big Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Impetus Career Consultants Private Limited Full time

    We are hiring for one the IT big4 consulting.Location : Req : - AWS (Big Data services) S3, Glue, Athena, EMR.- Programming Python, Spark, SQL, Mulesoft,Talend, Dbt.- Data warehouse ETL, Redshift / Responsibilities : - Work with business stakeholders to understand their business needs.- Create data pipelines that extract, transform, and load (ETL) from...