
Big Data DevOps Lead
3 days ago
Summary:
As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.
Main Responsibilities:
Driving improvement of the efficiency of Big Data infrastructure.
- Coordinating cross-team infrastructure and Big Data initiatives.
- Leading Big Data related architecture and design efforts.
- Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
- Building and supporting tools for operational tasks. Evaluating, designing, deploying monitoring tools.
- Design and implementation of DR/BC practices and procedures.
- On-call support of production systems.
Requirements:
7+ years of experience working with Hadoop, preferably Open Source.
- 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
- Experience setting up and running Hadoop clusters of 1000+ nodes.
- Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
- Experience running and troubleshooting Kafka.
- Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet. Proficiency in shell scripting.
Nice to have:
Experience with Prometheus.
- Experience managing Showflake. Solid knowledge of Graphite and Grafana.
- Python or Perl scripting skills.
- Experience with installing and managing Aerospike.
- DBA experience with one of: PostgreSQL, MySQL, MariaDB.
-
Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India TECHOAKS IT SOLUTIONS PRIVATE LIMITED Full timeFull-time with Info ServicesClient: Disney (Offshore)Job Description :Java with Big DataMust have skills :- 8+ years of total work experience is expected.- Java, Big Data, Spring, Kafka, AWS, Scala, and Spark: All these are needed to be strong.Roles & Responsibilities :- Design and Development: Architect, design, and develop high-performance, scalable, and...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000Job Title: Data Engineering LeadMain responsibilities include designing, developing and implementing data pipelines using ADF for data ingestion and transformation.The ideal candidate will have hands-on experience with Azure services such as ADLS, Azure Databricks, Data Factory, Synapse, and Azure SQL DB. Familiarity with DevOps and CI/CD deployments is a...
-
Big Data Engineer
2 days ago
Hyderabad, Telangana, India Vaakruthi Full time ₹ 1,04,000 - ₹ 1,30,878 per yearRole & responsibilitiesJob Description : Big Data EngineerAnalyze, Code , Test and Implement Big Data Applications (API & Batch) Manage and mitigate incidentsRequired Qualifiactions:years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra,Python, Hadoop, HDFS,...
-
Big Data Specialist
3 days ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Big Data EngineerLooking for a skilled Big Data Engineer to join our team. The ideal candidate should have a minimum of 5+ yrs. of experience in designing, developing and maintaining data pipelines.About the role:Design, develop and maintain data pipelines for ingestion, transformation and storage of large-scale data.Work with Big Data ecosystems (Hadoop,...
-
Big Data
3 days ago
Hyderabad, Telangana, India HSBC Full time US$ 90,000 - US$ 1,20,000 per yearJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest...
-
Devops Lead
3 days ago
Hyderabad, Telangana, India Jio Full time ₹ 9,00,000 - ₹ 12,00,000 per yearTitle: Data Operations Lead - DevopsLocation: HyderabadResponsibilities:1.Minimum of 5-7 years of Hands-on Azure Administration and Governance.2.Well versed with Hybrid Cloud workloads management with good understanding of Azure Networking(setting up VNETS, NSG's, NAT, Route tables), AKS orchestration, App services, Logic Apps, Storage accounts, Key Vaults...
-
Distinguished Data Scientist
1 week ago
Hyderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000Senior Data EngineerThe successful candidate will lead the design and development of ETL pipelines using Azure Data Factory for data ingestion and transformation.In this role, you will collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions.You will write efficient code in SQL, Python, and PySpark for data processing...
-
Senior Software Engineer-Big Data
3 days ago
Hyderabad, Telangana, India ORBCOMM Full time ₹ 15,00,000 - ₹ 20,00,000 per yearJoin Us as a Senior Software Engineer – Big DataAre you ready to lead high-impact initiatives in a fast-paced, global technology environment? At ORBCOMM, we're seeking aSenior Software Engineer – Big Datato design, develop, and implement high-performance analytics solutions. In this role, you'll leverage your expertise in distributed systems, real-time...
-
Lead/Senior Data Engineer
3 days ago
Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per yearWe are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...
-
Big Data Architect
1 week ago
Hyderabad, Telangana, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000Job Title: Big Data ArchitectWe are seeking a highly skilled professional to lead the design and implementation of our big data infrastructure.Responsibilities:Develop and maintain high-performance big data applications using Python, PySpark, and Spark Dataframes.Design and implement scalable data architectures to process huge volumes of data.Collaborate...