Current jobs related to Senior Dev Engineer- Data Platform - Pune, Maharashtra - The Product Guys

  • Senior Cloud Engineer

    2 weeks ago

    Pune, Maharashtra, India FIS Global Full time

    About the RoleThe Senior Lead Engineer will play a critical role in developing our next-generation compliance platform. You will be working closely with our development teams to manage and support Snowflake environments on AWS Cloud clusters. This position requires strong leadership skills, technical expertise, and excellent communication skills to...

  • Data Platform Architect

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Global Delivery Services Limited Full time

    Role Summary:The Senior Data Engineer will be responsible for designing and developing big data platforms using Spark, HBase, Hive, and other Hadoop ecosystem technologies. This role requires expertise in data processing technology stacks and development using Scala or Java. The ideal candidate will have hands-on experience in streaming data architectures...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior software engineering manager

    3 weeks ago

    Pune, Maharashtra, India Antal International Full time

    Senior Manager, Engineering - Software Architecture and Cloud Support Location: Pune Role Overview: My Client is a leading global product organisation based in the US, and have a state-of-the-art engineering center in Pune. They are looking for a Senior Manager of Architecture and Cloud Support, who will build, lead and manage a high-performance team focused...

  • Senior Data Engineer

    3 days ago

    Pune, Maharashtra, India Cloudaeon Full time

    About the Company:Cloudaeon is a global technology consulting and services company.We support companies in managing cloud infrastructure and solutions with the help of big data, Dev Ops, and analytics.We offer first-class solutions and services that use big data and always exceed customer expectations.Our deep vertical knowledge, combined with expertise in...

  • Senior Data Engineer

    1 week ago

    Pune, Maharashtra, India Cloudaeon Full time

    About the Company: Cloudaeon is a global technology consulting and services company.We support companies in managing cloud infrastructure and solutions with the help of big data, Dev Ops, and analytics.We offer first-class solutions and services that use big data and always exceed customer expectations.Our deep vertical knowledge, combined with expertise in...

  • Data engineer

    2 days ago

    Pune, Maharashtra, India Alp Consulting Ltd. Full time

    Data EngineerDomain : Pharma / Pharmacy / PharmaceuticalCloud Platforms: AWS (S3, EC2, Lambda), optional - Azure (Data Lake, Azure Functions)Programming Languages: Python (Dash, Pandas, Num Py), SQLDev Ops Tools: Jenkins, Git, Git HubDatabase Technologies: My SQL, Postgre SQL, No SQL databasesCertification in AWS Solutions Architect / Microsoft Azure Data...

  • Senior Platform Devops Engineer, Data And Analytics Platform

    1 week ago

    Pune, Maharashtra, India KONE Full time

    Senior Platform DevOps Engineers for Databricks on AWS based platformTo join the team developing and operating modern Databricks on AWS based data and analytics platform in Pune in India Teams purpose is to develop and operate a scalable and secure cloud-based data and analytics platform on which other data and analytics teams can with ease develop and run...

  • Senior Data Platform Specialist

    2 weeks ago

    Pune, Maharashtra, India Ollion Full time

    Job DescriptionThe Senior Data Engineering Consultant will be responsible for gathering requirements, designing, and building modern data platforms to support data-driven decision making. This role involves executing technical implementation of data engineering and visualization projects, with a focus on hands-on execution.The ideal candidate will help build...

  • Data Platform Engineer

    2 weeks ago

    Pune, Maharashtra, India Panzer Technologies Pvt Ltd Full time

    Job Title: Senior Data Platform Engineer Location: Pune (Hybrid/Remote – specify as per company policy) Experience: 5+ years Key Responsibilities: Data Pipeline Architecture: Build and optimize large-scale data ingestion pipelines from multiple sources. Scalability & Performance: Ensure low-latency, high-throughput data processing for real-time and batch...

  • Senior Engineering Position for Data Platforms

    21 hours ago

    Pune, Maharashtra, India beBee Careers Full time

    Position Overview:We are seeking a highly skilled Senior Data Platform Engineer to join our team. The successful candidate will be responsible for designing and implementing scalable data platforms using cloud-based technologies.Main Responsibilities:Design and implement data pipeline architectures that meet scalability and performance requirements.Develop...

  • Platform Engineer

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 285103NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Platform Engineer to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Job Duties Quickly...

  • Platform Engineer

    7 days ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 285109NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Platform Engineer to join our team in Pune Mah xc4 x81r xc4 x81shtra IN-MH India IN Job Duties Quickly...

  • Senior Data Ops Engineer

    7 hours ago

    Pune, Maharashtra, India Luxoft Full time

    Project Description:Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analyticsResponsibilities:Web scraping...

  • Senior Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Ciklum Full time

    Description Ciklum  is looking for a Senior Data Engineer  to join our team full-time in India. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and...

  • Platform Product Tester

    2 weeks ago

    Pune, Maharashtra, India Parallel Wireless Full time

    As a Senior QA Engineer at Parallel Wireless, you will play a critical role in ensuring the quality and stability of our Platform products.ResponsibilitiesDesign and build end-to-end test setups based on test requirements, analyzing and debugging logs for test simulators and systems under test.Verify Parallel Wireless Platform Products and Applications for...

  • Data Platform Engineer Lead

    1 week ago

    Pune, Maharashtra, India Autodesk Full time

    About the RoleWe are looking for a highly skilled Senior Platform Engineer to join our Data Platform team at Autodesk. In this role, you will be responsible for defining and aligning data platform usage from an organizational perspective, ensuring that our data lake and data warehouse environment is optimized and effectively supports our business needs.You...

  • Senior Integration Engineer

    1 week ago

    Pune, Maharashtra, India NTT DATA Full time

    At NTT DATA, we are seeking a skilled Senior Lead Engineer to join our team in Pune. As part of our collaborative and forward-thinking organization, you will have the opportunity to work on client engagements, design and implement customized integration solutions, and participate in project requirements meetings with business analysts and architects.Key...

  • Data Engineering Lead

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Global Delivery Services Limited Full time

    Job DescriptionWe are seeking a highly skilled Big Data Senior Developer to join our team at NTT DATA Global Delivery Services Limited.This role involves designing and developing big data platforms, leveraging expertise in data engineering, Spark, HBase, Hive, and other Hadoop ecosystem technologies.The ideal candidate will have hands-on experience with...

  • Cloud Infrastructure Engineer

    2 weeks ago

    Pune, Maharashtra, India Undisclosed Full time

    We are seeking a highly skilled Senior Cloud Administrator/Dev Ops Engineer with expertise in Kubernetes, AWS and CI/CD. As a key member of our Dev Ops team, you will be responsible for designing, implementing, and maintaining the infrastructure and deployment pipelines for cloud-based applications and services on the AWS platform. Key Responsibilities:...

Senior Dev Engineer- Data Platform

1 month ago

Pune, Maharashtra, India The Product Guys Full time

Responsibilities include but are not limited to the following: 

● Optimize Spark clusters for cost, efficiency and performance by implementing robust monitoring systems to identify bottlenecks using data and metrics. Provide actionable recommendations for continuous improvement 

● Optimize the infrastructure required for extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies 

● Work with data and analytics experts to strive for greater cost efficiencies in our data systems 



Requirements

Who you are: 

● Experience with processing large workloads and complex code on Spark clusters 

● Proven experience in setting up monitoring for Spark clusters and driving optimization based on insights and findings 

● Experience in designing and implementing scalable Data Warehouse solutions to support analytical and reporting needs 

● Strong analytic skills related to working with unstructured datasets 

● Build processes supporting data transformation, data structures, metadata, dependency, and workload management 

● Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores 

Experience using the following software/tools: 

● Expertise with Python and Jupyter notebooks is a MUST. 

● Experience with big data tools: Spark, Kafka, etc. 

● Experience with relational SQL and NoSQL databases, including Postgres and Cassandra 

● Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. 

● Experience with AWS cloud services: EC2, EMR, RDS, Redshift 

● Working knowledge of stream-processing systems: Storm, Spark-Streaming, etc. is a plus