
Big Data Pipeline Specialist
2 days ago
We are looking for an experienced Data Engineer to join our team at VAYUZ Technologies. As a key member of our data engineering department, you will be responsible for designing, developing, and maintaining large-scale data pipelines.
Key Responsibilities:
- Design and develop efficient data pipelines using Python and SQL, ensuring smooth data flow and integration across systems.
- Collaborate with cross-functional teams, including data scientists and software engineers, to ensure seamless data integration and analysis.
- Stay informed about industry trends and emerging technologies, continuously improving data engineering processes.
- Set up and manage data warehouses and lakes, implementing industry best practices for data management.
Requirements:
- Bachelor's or Master's degree in Computer Science, Data Science, or related field.
- Minimum 3 years of experience as a Data Engineer, with strong proficiency in Python programming language and SQL.
- Experience in setting up and managing data pipelines, data warehouses/lakes, and cloud-based platforms (AWS/Azure/GCP).
- Strong analytical and problem-solving skills, with ability to work under pressure and meet deadlines.
Preferred Skills:
- Familiarity with containerization tools like Docker or Kubernetes.
- Knowledge of big data technologies such as Hadoop or Spark or Snowflake.
- Experience with data visualization tools like Tableau or PowerBI.
-
Data Pipeline Specialist
7 days ago
Hyderabad, Telangana, India FedEx ACC Full timeJob OverviewFedEx ACC is seeking a highly skilled Data Pipeline Specialist to join our team. The ideal candidate will have experience in designing, building, testing, and maintaining large-scale data pipelines, as well as working with multiple teams and data sources.The specialist will be responsible for processing batch data, formatting it to match stored...
-
Big Data Engineer, Data Modeling
3 weeks ago
Hyderabad, Telangana, India data Remote Work Freelance Full timeWhat can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...
-
Big Data Solutions Specialist
6 days ago
Hyderabad, Telangana, India Rsn Ginfo Solutions Private Limited Full timeCompany OverviewRsn Ginfo Solutions Private Limited is an IT consulting firm that delivers innovative solutions to clients. Our team of experts stays up-to-date with the latest technology trends and provides high-quality services to clients across various industries.Job DescriptionWe are looking for a Big Data Solutions Specialist to join our data analytics...
-
Data Pipeline Specialist
4 days ago
Hyderabad, Telangana, India b4uleap Full timeAWS Data Engineer RoleAs an AWS Data Engineer at b4uleap, you will design, build, and manage robust data pipelines on the AWS cloud platform. You will leverage your expertise in AWS data services and programming languages to ingest, process, transform, and store data efficiently, enabling data-driven insights and decision-making.Key Responsibilities:-...
-
Senior Consultant Specialist in Big Data
4 days ago
Hyderabad, Telangana, India HSBC Full timeJob Title: Senior Consultant Specialist - Big DataJob Summary:This role involves designing and implementing big data solutions using Pyspark and GCP technologies. The successful candidate will have a strong background in software engineering, data architecture, and cloud computing, with excellent problem-solving and analytical skills.Key...
-
Big Data Architecture Specialist
5 days ago
Hyderabad, Telangana, India Micron Semiconductor Asia Operations Pte. Ltd Full time**Job Title:** Big Data Architecture Specialist**Job Summary:**Micron Semiconductor Asia Operations Pte. Ltd is seeking a highly skilled and experienced Big Data Architecture Specialist to join our team.The ideal candidate will have a strong technical background in cloud data warehouse technologies, machine learning, and advanced analytics, with experience...
-
Big Data Engineer, Data Analysis
3 weeks ago
Hyderabad, Telangana, India data Remote Work Freelance Full timeWhat can you tell your friends when they ask you what you do? "As a Data Analyst at data.ai, I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing...
-
Big Data Engineer
7 days ago
Hyderabad, Telangana, India SMARTWORK IT SERVICES Full timeJob Title : Big Data Engineer (Dynatrace)Location : Chennai, Bangalore, HyderabadExperience : 6-10 YearsRequired skills : Big Data, DynatraceJob Description : We are looking for an experienced Big Data Engineer (Dynatrace) with building scalable data pipelines and ensuring performance optimization through Dynatrace monitoring. This role requires a seasoned...
-
Big Data Pipeline Developer
2 days ago
Hyderabad, Telangana, India S P A Enterprise Info Services (India) Pvt Ltd Full timeAbout the Role:We are seeking an experienced Data Engineer to join our team at S P A Enterprise Info Services (India) Pvt Ltd. As a key member of our data engineering team, you will be responsible for designing and implementing efficient data pipelines using Databricks, writing high-quality SQL code, and collaborating with cross-functional teams to...
-
Big Data Integration Specialist
4 days ago
Hyderabad, Telangana, India algoleap Full time**Required Skills and Qualifications**To succeed in this role, you should have:Strong understanding of ETL/ELT pipelines, data integrationFamiliarity with big data and streaming technologies (Kafka, Spark, Hadoop, etc.)Knowledge of Java or Python as well as Streamsets and/or other data pipeline technologies**Benefits**As a valued member of our team, you can...
-
Big Data Engineer Specialist
4 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeWelcome to TATA CONSULTANCY SERVICES LIMITEDWe are seeking an experienced Big Data Engineer to join our team.About the Role:This is a senior-level position requiring 5-8 years of experience in designing and implementing big data solutions using Azure Databricks, Azure Data Factory, and Azure Synapse Analytics.Main Responsibilities:Lead the development of...
-
Big Data Engineer Specialist
1 day ago
Hyderabad, Telangana, India Insight Global Full timeAt Insight Global, we are seeking a highly skilled Data Scientist to lead our big data engineering team. About the Role:We require a professional with extensive experience in designing and implementing scalable ETL data pipelines using Apache Spark.The ideal candidate will have hands-on experience with Scala or Python programming languages and advanced SQL...
-
Data Pipeline Engineer
4 days ago
Hyderabad, Telangana, India algoleap Full time**Job Description**Our ideal candidate has strong experience with ETL/ELT pipelines, data integration, and big data technologies such as Kafka, Spark, and Hadoop. You will work closely with data analysts, developers, and DevOps teams to support data-driven solutions.- Ingest, transform, and distribute data across multiple sources such as databases, APIs,...
-
Big data engineer
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeBig data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...
-
Big Data Python Engineer
3 weeks ago
Hyderabad, Telangana, India Virtusa Full timeBig Data Python Engineer - CREQ191701 Description Role GDT WS Big Data Python Engineer Exp 5+ Location Pune/Hyderabad MUST Have Skills Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Airflow Jenkins Understand business requirements to code up data assets...
-
Data Pipeline Specialist
6 hours ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeJob SummaryTata Consultancy Services is seeking a highly skilled Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Synapse Analytics and Azure Databricks.You will work closely with our cross-functional teams to identify business needs and develop solutions...
-
Big Data Engineer
7 hours ago
Hyderabad, Telangana, India Skyleaf Consultants LLP Full timeAbout This OpportunitySkyleaf Consultants LLP is looking for a skilled Big Data Engineer to join our team.The successful candidate will have expertise in working with large datasets and experience using machine learning pipelines and integration within Databricks. They will also be responsible for enforcing best practices for data quality, governance, and...
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Folks Palette LLP Full timeJob Description : We are seeking an experienced Big Data Engineer with PySpark Developer to join our dynamic team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data solutions in a big data ecosystem. The ideal candidate will have a strong background in big data technologies,...
-
Big Data Engineer Position
5 days ago
Hyderabad, Telangana, India Insight Global Full timeJob DescriptionWe are seeking a highly skilled professional with a strong background in designing and implementing ETL data pipelines using Apache Spark and either Scala or Python. The ideal candidate will have a deep understanding of big data frameworks, advanced SQL skills, and hands-on experience with Elasticsearch. Key responsibilities include building...
-
Data Engineer for Scalable Data Pipelines
7 days ago
Hyderabad, Telangana, India CIEL HR Full timeJob Description:As a Spark Engineer at CIEL HR, you will be responsible for designing and implementing high-performance data ingestion pipelines from multiple sources using Apache Spark. You will work closely with the project team to deliver scalable and reusable frameworks for ingesting geospatial data sets. Additionally, you will integrate end-to-end data...