Big data support
22 hours ago
Qualifications- We are looking for skilled ETL pipeline support engineer to join Dev Ops team. In this role, you will be ensuring the smooth operation of PROD ETL pipelines. Also responsible for monitoring, troubleshooting existing pipelines.- This role requires a strong understanding of SQL, Spark, and experience with AWS Glue and Redshift.- Has basic level of understanding on Databricks and Debugs ETL running on Databricks- Required Skills and Experience:- Bachelor's degree in computer science, Engineering, or a related field.- Proven experience in supporting and maintaining ETL pipelines.- Strong proficiency in SQL and experience with relational databases (e.g., Redshift).- Solid understanding of distributed computing concepts and experience with Apache Spark.- Hands-on experience with AWS Glue and other AWS data services (e.g., S3, Lambda).- Experience with data warehousing concepts and best practices.- Excellent problem-solving, analytical skills and strong communication and collaboration skills.- Ability to work independently and as part of a team.- Preferred Skills and Experience:- Experience with other ETL tools and technologies- Experience with scripting languages (e.g., Python).- Familiarity with Agile development methodologies.- Experience with data visualization tools (e.g., Tableau, Power BI)Roles & Responsibilities- Monitor and maintain existing ETL pipelines, ensuring data quality and availability.- identify and resolve pipeline issues and data errors.- Troubleshoot data integration processes.- If needed, collaborate with data engineers and other stakeholders to resolve complex issues- Develop and maintain necessary documentation for ETL processes and pipelines.- Participate in on-call rotation for production support.
-
Big Data Developer
3 days ago
Pune, Maharashtra, India Talent Worx Full timeWe're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...
-
Big Data Developer
4 days ago
Pune, Maharashtra, India Talent Worx Full timeWe're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...
-
Big data developer
4 weeks ago
Pune, India Airtel Full timeJob Title: Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...
-
Big Data Engineer
1 week ago
Pune, Maharashtra, India Vodafone Full timeDesign, develop, and maintain scalable data pipelines for processing structured and unstructured data. Build and optimise data storage solutions including distributed file systems, NoSQL databases, and data warehouses. Utilise big data frameworks such as Apache Hadoop, Spark, Flink, and Kafka to develop data processing workflows. Ensure high performance and...
-
Big data developer
4 weeks ago
Pune, India Airtel Full timeJob profiles - Big Data Developer (Senior Manager)Experience - 7-10 yrsLocation - PuneJob DescriptionWe are seeking a highly skilled Lead Big Data Developer to architect, drive, and optimize large-scale data engineering solutions in a modern, modular, and highly automated environment. The ideal candidate will have extensive experience in building and leading...
-
Big Data Developer
1 week ago
Pune, Maharashtra, India airtel Full timeJob Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...
-
Big data specialist
4 weeks ago
Pune, India Atomic North Full timeBig Data EngineerLocation: Pune/Nagpur (WFO)Experience Required: 8+ Years**Long term onsite to Abu Dhabi**Job Summary:- We are looking for an experienced Big Data Engineer with strong expertise in Py Spark and Big Data ecosystems.- The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...
-
Intern- Big Data
2 weeks ago
Pune, Maharashtra, India Seagate Technology Full time**About our group**: We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business...
-
Big Data Expert
7 days ago
pune, India beBeeData Full timeJob OpportunityUnlock valuable business insights by leveraging big data technologies.Demonstrated expertise in high-tech industry and/or IT with development and solution engineering backgrounds.Key ResponsibilitiesCrafting and maintaining large-scale data pipelines for efficient processing.Designing scalable infrastructure for cloud-based data...
-
Big Data Specialist
3 weeks ago
Pune, India Emergys Full timeWork Location: Pune (Work-from-Office)⏳ Notice Period: Immediate to 30 DaysExperience: 8+ YearsMust Have Skills:- Data Architecture & Design – Expertise in designing scalable and resilient data architectures for batch and streaming systems.- Data Modeling & Integration – Strong ability to build efficient data models and integrate data from multiple...