Senior Data Engineer

1 week ago


Bangalore Metropolitan Area, India Applicantz Full time

THIS IS A CONTRACT POSITION WITH ONE OF THE LARGEST, GLOBAL, TECHNOLOGY LEADER.


Our large, Fortune client is ranked as one of the best companies to work with, in the world. The client fosters progressive culture, creativity, and Flexible work environment. They use cutting edge technologies to keep themselves ahead of the curve. Diversity in all aspects is respected. Integrity, experience, honesty, people, humanity, and passion for excellence are some other adjectives that define this global technology leader.


Responsibilities:

  • Deploy and configure Apache Spark clusters on AWS (particularly EKS), optimizing for performance, resource allocation, and scalability.
  • Develop, automate, and support robust and reliable Spark data pipelines, focusing on high performance and low latency.
  • Design and implement highly optimized queries to improve data processing efficiency, streamline analysis, minimize latency, and enhance overall system performance.
  • Collaborate to make the Data Platform an effective, scalable, and resilient system.
  • Gather requirements from stakeholders, prioritize work, and document technical solutions clearly and effectively.
  • Engage with data engineers, data scientists, product managers, and internal stakeholders to align project goals and implementations.
  • Contribute to a team culture that values quality, robustness, and scalability while fostering initiatives and innovation​


Minimum Qualifications:

  • 5+ years of data processing experience in large cloud-based infrastructure (AWS is must)
  • Hands-on software development experience in Python, with strong proficiency in Py Spark for data engineering tasks and data pipeline development
  • Expert understanding of SQL, dimensional modeling, and analytical data warehouses, such as Snowflake
  • Understanding of Data Engineering best practices for medium to large scale production workloads
  • Expertise with data pipeline orchestration tools, such as Airflow
  • Familiar with processing semi-structured file formats such as json or parquet
  • Team player with good communication skills
  • Problem solver with excellent written and interpersonal skills
  • Strong problem-solving skills
  • Ability to learn new technical skills
  • Bachelor’s degree in Computer Science, Data Science, or related fields


Preferred Qualifications:

  • Experience with Jinja, Shell scripting, DBT
  • Developing in Cloud platform using serverless technologies such as glue, lambda, EMR is a plus.
  • Experience with remote development using AWS SDK is a plus
  • Experience with ELT pipelines - DBT
  • REST API design and implementation
  • Familiarity with containers and infrastructure-as-code principles
  • Experience with automation frameworks - Git, Jenkins, and Terraform

  • Senior Data Engineer

    3 weeks ago


    Bangalore Metropolitan Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 7+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...


  • Bangalore Metropolitan Area, India CodeVyasa Full time

    Looking for Senior Data Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of...


  • Bangalore Metropolitan Area, India CodeVyasa Full time

    At CodeVyasa, we're on a mission to revolutionize data processing with our team of rockstar developers. As a Senior Data Engineer, you'll play a crucial role in designing and implementing cutting-edge data pipelines using PySpark for both streaming and batch processing.We're looking for an experienced professional with a minimum of 7+ years of experience in...

  • Senior Data Engineer

    1 month ago


    Bangalore Metropolitan Area, India Snaphunt Full time

    The OpportunityWe're seeking a highly skilled Senior Data Engineer - Machine Learning to join our team at Snaphunt. As a key member of our engineering team, you'll be responsible for designing, developing, and deploying scalable data pipelines and machine learning models.The RoleArchitect and implement end-to-end data pipelines using Python and relevant...


  • Bangalore Metropolitan Area, India CodeVyasa Full time

    Role SummaryCodeVyasa is seeking a seasoned Snowflake Data Engineer with expertise in Python to lead the migration of complex SAS processes to Snowflake. The successful candidate will have a strong background in data engineering, data warehousing, and cloud-based solutions.Key Responsibilities:Design, build, and manage end-to-end data pipelines using...

  • Senior Data Scientist

    1 month ago


    Bangalore Metropolitan Area, India Snaphunt Full time

    The OpportunityWe are seeking a highly skilled Senior Data Scientist to join our team at Snaphunt. As a key member of our remote sensing team, you will play a crucial role in developing and implementing data-driven solutions for our satellite data analysis projects.Key Responsibilities:Develop and implement advanced machine learning models and algorithms for...

  • Senior MLOps Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India Snaphunt Full time

    The OpportunityWe are seeking a highly skilled Senior MLOps Engineer to join our team at Snaphunt. As a key member of our AgriTech startup, you will play a pivotal role in shaping our high-impact product driving the future of Agriculture.Key ResponsibilitiesDesign and implement automated ML pipelines for developing, testing, deploying, and monitoring ML...


  • Bangalore Metropolitan Area, India Recro Full time

    Are you a skilled developer looking for a challenging role that combines data and machine learning expertise?At Recro, we empower talented developers by providing them with relevant experience at fast-growing startups based on technical competencies and aspirations. We strive to create optimal business outcomes for high-growth startups.About the RoleWe are...

  • Senior MLOps Engineer

    2 weeks ago


    Bangalore Metropolitan Area, India a Snaphyre Client Full time

    We are seeking a highly skilled Senior MLOps Engineer to join our team at a Snaphyre Client, a pioneering AgriTech startup. Our mission is to create value by visualizing agricultural land, enabling sustainable farming practices, reducing carbon emissions, and driving positive change for farmers, the planet, and future generations.The RoleAs a key member of...

  • Data Engineer

    3 weeks ago


    Bangalore Metropolitan Area, India Kratos Gamer Network Full time

    About KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...

  • Senior Data Scientist

    4 weeks ago


    Bangalore Metropolitan Area, India Sagri Full time

    Sagri Inc. is a pioneering social impact startup that utilizes satellite data and AI technology to address global food crises and climate change challenges. Our core products - Actaba, Detaba, and Sagri - offer innovative solutions in agricultural management and optimization. We are now developing an advanced MRV (Measure, Report, and Verify) and...

  • Senior Data Scientist

    4 weeks ago


    Bangalore Metropolitan Area, India Sagri Full time

    Sagri Inc. is a pioneering social impact startup that leverages satellite data and AI technology to address global food crises and climate change challenges.We are developing an advanced MRV (Measure, Report, and Verify) and decarbonization platform for agricultural enterprises, aimed at revolutionizing sustainability practices in the agricultural sector.The...

  • Lead Data Engineer

    10 hours ago


    Bangalore Metropolitan Area, India SMC Squared India Full time

    Job Title: Lead Data Engineer Location: Bangalore Experience: 7+ YearsWork Mode: Hybrid(3 days WFO) Job Type:Full-time/Permanent Notice Period: Immediate to 15 days.----------------------------------------------------------------------------------------------------------------------------------------------------------------------Job Description:We are...


  • Bangalore Metropolitan Area, India Oblivious Full time

    Job Title: Senior Algorithms Engineer (Python AST, Static Analysis Tools, and Differential Privacy)Location: HybridEver wanted to join a vibrant young start-up? To tangibly change the world for the better?At Oblivious.com, we are looking to onboard a highly skilled Algorithms Engineer who will work on the Python AST to build static analysis tools and work...

  • Data Engineer

    3 weeks ago


    Bangalore Metropolitan Area, India Kunato Full time

    We are seeking a dynamic and driven Data Engineer with a strong blend of technical expertise and business acumen. In this role, you will collaborate with cross-functional teams, including Software Engineers, Data Scientists, Business Analysts, Product Managers, and other key stakeholders, to develop innovative data solutions that fuel business insights and...

  • Senior MLOps Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India a Snaphyre Client Full time

    Our client, a pioneering AgriTech startup, is revolutionizing agriculture and the environment by harnessing satellite data, artificial intelligence, and grid technology.The RoleAs a seasoned Senior MLOps Engineer, you will oversee the entire lifecycle of machine learning models, from development to production, with a focus on automation, scalability, and...

  • Senior ML Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India Snaphunt Full time

    The OpportunityWe are seeking a skilled Senior ML Ops Engineer to join our team at Sagri, a pioneering AgriTech startup. As a key member of our Data Science team, you will play a pivotal role in shaping our high-impact product driving the future of Agriculture.The RoleDesign and implement automated ML pipelines for developing, testing, deploying, and...

  • Senior MLOps Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India a Snaphyre Client Full time

    Our client is a pioneering AgriTech startup that combines satellite data, artificial intelligence, and grid technology to tackle critical challenges in agriculture and the environment. Their mission is to create value by visualizing agricultural land, enabling sustainable farming practices, reducing carbon emissions, and driving positive change for farmers,...

  • Senior MLOps Engineer

    4 weeks ago


    Bangalore Metropolitan Area, India Snaphunt Full time

    The OfferWork with a well-funded AgriTech startup tackling critical challenges in Agriculture and the EnvironmentPlay a pivotal role in shaping a high-impact product driving the future of AgricultureWork with state-of-the-art technologies in AI, remote sensing, and data analytics The JobAs a skilled and committed Senior MLOps Engineer, you will oversee the...


  • Bangalore Metropolitan Area, India Luxoft Full time

    We've been engaged by a large UK Based Investment Bank in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .RESPONSIBILITIES• Ensuring quality service output, submitted in a timely manner and communicated effectively• Continuous...