Senior/Lead Big Data Engineer
1 week ago
Big Data Developer
Job Description :
- Participate in the design and implementation phases for data projects to help translate high level business requirements into technical solutions
- Provide technically sound solutions for the ingestion, storage, transformation, and presentation of enterprise data, including ETL design, data storage strategies, data access and security
- Driving the design of scalable solutions while considering recoverable and resiliency requirements
- Participate in DevOps related activities, including involvement with continuous integration, automated deployment, automated testing, and continuous monitoring to enhance performance and product quality
- Provide timely support for troubleshooting and resolving production issues
Required Technical and Professional Expertise :
- Experience with any of the following : Big Data technologies, Analytics, Hadoop ecosystems, DataLakes, or Data Migration
- Experience with cloud platforms such as AWS, Azure, or Google Cloud
- Experience with Java, Scala, Spark
- Strong database integration and management skills
- Strong ETL skills, including database performance tuning and optimization
- Familiar with Shell scripting skills and Unix/Linux knowledge
- Exceptional analytical and problem-solving skills
- Running diagnostic tests and performing debugging procedures
- Documenting application development processes, procedures, and standards
- Excellent leadership and interpersonal skills
- Strong communication and team working skills
- Able to analyze complex situations and derive workable actions
- Flexibility to adjust to multiple demands, shifting priorities, ambiguity and rapid change
Preferred Technical And Professional Expertise :
- Knowledge of DevOps and related tooling such as Jenkins, Ansible etc.
- Experience with Big Data technologies such as Apache Hadoop, HBase, Hive, Spark, Flink or Flume
- Strong coding skills in one of Python/Java/Scala
- Familiar with event management technologies such as Apache Kafka or Apache Airflow
- Familiar with container technologies such as Docker or Kubernetes
- Demonstrable experience coaching junior members of your teams
-
Big Data Engineer, Data Modeling
2 weeks ago
Hyderabad, Telangana, India data Remote Work Freelance Full timeWhat can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...
-
Senior Big Data Engineer Lead
5 days ago
Hyderabad, Telangana, India Micron Semiconductor Asia Operations Pte. Ltd Full timeWe are looking for leaders with strong technical experience in Big Data and Cloud Data warehouse technologies. This role will work primarily in Cloud data warehouse like Snowflake and GCP platforms, monitoring solutions such as Splunk and automation and machine learning using Python.Key Skills and Qualifications:10+ years developing, delivering, and/or...
-
Big Data Engineering Lead
3 days ago
Hyderabad, Telangana, India Talescope Full timeAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Talescope. As a key member of our engineering team, you will be responsible for leading the design and implementation of complex, scalable data pipelines using AWS services. You will work closely with cross-functional teams to understand their data needs and translate them...
-
Big Data Engineer, Data Analysis
2 weeks ago
Hyderabad, Telangana, India data Remote Work Freelance Full timeWhat can you tell your friends when they ask you what you do? "As a Data Analyst at data.ai, I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing...
-
Big Data Engineer Specialist
1 day ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeWelcome to TATA CONSULTANCY SERVICES LIMITEDWe are seeking an experienced Big Data Engineer to join our team.About the Role:This is a senior-level position requiring 5-8 years of experience in designing and implementing big data solutions using Azure Databricks, Azure Data Factory, and Azure Synapse Analytics.Main Responsibilities:Lead the development of...
-
AWS Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Tiger Analytics Full timeJob Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...
-
Big Data Engineer
5 days ago
Hyderabad, Telangana, India SMARTWORK IT SERVICES Full timeJob Title : Big Data Engineer (Dynatrace)Location : Chennai, Bangalore, HyderabadExperience : 6-10 YearsRequired skills : Big Data, DynatraceJob Description : We are looking for an experienced Big Data Engineer (Dynatrace) with building scalable data pipelines and ensuring performance optimization through Dynatrace monitoring. This role requires a seasoned...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full timeEnable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...
-
Senior Consultant Specialist in Big Data
2 days ago
Hyderabad, Telangana, India HSBC Full timeJob Title: Senior Consultant Specialist - Big DataJob Summary:This role involves designing and implementing big data solutions using Pyspark and GCP technologies. The successful candidate will have a strong background in software engineering, data architecture, and cloud computing, with excellent problem-solving and analytical skills.Key...
-
Big data engineer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeBig data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...
-
Senior Big Data Engineer
1 week ago
Hyderabad, Telangana, India Info Services Full timeJob DescriptionTitle: Big Data EngineerLocation: Financial District, Hyderabad - HybridType: OffshoreShift Timings: 1:00pm - 10:00pm ISTMode: Fulltime Role.We are looking for someone who can:- Support large data distributed pipelines that span across Airflow, Databricks and Snowflake. Some knowledge with Airflow is good to have to understand how the DAGs...
-
Senior Data Engineering Lead
11 hours ago
Hyderabad, Telangana, India Anblicks Full timeWe are seeking a highly skilled Data Engineer to join our team at Anblicks. As a Senior Data Engineering Lead, you will play a key role in designing and developing scalable data solutions using Python and PySpark.Key Responsibilities:Design and develop ETL/ELT data pipelines using Python and PySparkBuilt and maintain large-scale data processing frameworks...
-
Senior Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Info Services Full timeTitle : Big Data Engineer. Location : Financial District, Hyderabad Hybrid. Type : Offshore. Shift Timings : 1:00pm 10:00pm IST. Mode : Fulltime Role.We are looking for someone who can : - Support large data distributed pipelines that span across Airflow, Databricks and Snowflake. - Some knowledge with Airflow is good to have to understand how the DAGs work,...
-
Senior Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Info Services Full timeTitle : Big Data Engineer. Location : Financial District, Hyderabad Hybrid. Type : Offshore. Shift Timings : 1:00pm 10:00pm IST. Mode : Fulltime Role.We are looking for someone who can : - Support large data distributed pipelines that span across Airflow, Databricks and Snowflake. - Some knowledge with Airflow is good to have to understand how the DAGs work,...
-
Big Data Engineer
2 weeks ago
Hyderabad, Telangana, India Questsphere Private ltd. Full timeOur client is looking to deploy big data engineer at one of the worlds top product company R&D centre based out of Hyderabad. As a Big Data Engineer, you are going to work with cross-functional collaboration and communication with members from other teams.As an Engineer, you are responsible to analyze large data sets to identify errors . You are responsible...
-
Big data Lead
2 days ago
Hyderabad, Telangana, India Tata Consultancy Services Limited Full timeJob DescriptionRole- Big data LeadJob DescriptionDesired Competencies (Technical/Behavioral Competency)- Big data- Spark- Scala- Project ManagementResponsibilities- Good experience in MQ or kafka or Rabbit MQ- Exp in .Terraform, Kubernete- CI/CD, Cloud- Good stakeholder management exp
-
Big Data Analytics Lead
7 days ago
Hyderabad, Telangana, India Live Connections Full timeJob DescriptionWe are seeking a seasoned Data Engineering Manager with extensive experience in Python and Big Data technologies to lead our analytics team in Hyderabad. As a key member of our organization, you will be responsible for driving data strategies that empower our business intelligence capabilities and contribute to data-driven decision-making...
-
15h Left: Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full timeEnable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...
-
Big Data Engineer
7 days ago
Hyderabad, Telangana, India Apollo HealthAxis Full timeJob DescriptionAs a Big Data Engineer at Apollo HealthAxis, you will be responsible for designing and implementing large-scale data processing systems using distributed computing technologies. You will work closely with cross-functional teams to understand business requirements and translate them into effective data architecture and...
-
Lead/Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Payoda Technologies Pvt. Ltd Full timeA global company in innovation, Payoda is at the forefront of digital transformation to enable enterprises across industries to use cutting-edge technology in the areas of cloud, advanced analytics, and user experience. Does the challenge of driving decisions in a dynamic environment excite you? Are you seeking an environment where you can drive innovation?...