Staff Big Data Engineer

4 days ago

Hyderabad, India Costco IT Full time

About Costco Wholesale Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members. At Costco Wholesale India, we foster a collaborative space, working to support Costco Wholesale in developing innovative solutions that improve members’ experiences and make employees’ jobs easier. Our employees play a key role in driving and delivering innovation to establish IT as a core competitive advantage for Costco Wholesale. Staff, Data Engineer Shape and drive enterprise-wide data architecture strategy: Define and evolve the long-term technical vision for scalable, resilient data infrastructure across multiple business units and domains. Architect and guide the implementation of data platforms and pipelines that enable analytics, AI/ML, and BI at an organizational scale. Introduce novel approaches in real-time processing, hybrid/multi-cloud, and AI/ML integration to transform how data is processed and leveraged across the enterprise. Influence Principal Engineers, Engineering Managers, and other Staff Engineers; Define and enforce best practices for data modeling, pipeline architecture, governance, and compliance at scale. Tackle systemic issues in data scalability, interoperability, and performance that impact multiple teams or the enterprise as a whole. Provide technical insights to senior executives on data strategy, emerging technologies, and long-term investments. Speak at industry events/conferences, publish thought leadership, contribute to open source and standards bodies, and lead partnerships with external research or academic institutions. 15+ years of experience ~ Mastery of data architecture and distributed systems at enterprise scale: Deep experience in GCP . ~ Advanced programming and infrastructure capabilities: Expertise in writing database queries, Python, or Java, along with infrastructure-as-code tools like Terraform or Cloud Deployment Manager. ~ Leadership in streaming and big data systems: Authority in tools such as BigQuery, Dataflow, Dataproc, Pub/sub for both batch and streaming workloads. ~ Design and implement standards for data quality, lineage, security, privacy (e.g., Strategic integration with AI/ML ecosystems: Architect platforms that serve advanced analytics and AI workloads (Vertex AI, TFX, MLflow). ~ Deep expertise in data architecture, distributed systems, and GCP. Python or Java, infrastructure-as-code (e.g. Big data tools: BigQuery(Expert level. Having experience on performance tuning and UDFs), Dataflow, Dataproc, Pub/Sub (batch + streaming) Data governance, privacy, and compliance (e.g. Data modeling and architecture - level expert, have experience on hybrid architectures SQL Skills level - Expert Deep understanding of BigQuery, have experience on partitioning, clustering and performance optimizations Experience on Cloud function, Composer and Cloud run, dataflow flex templates - should be able to write Understanding of full concepts of cloud architecture.

  • Fanatics - Staff Data Engineer - Big Data Technologies

    3 weeks ago

    Hyderabad, India Fanatics Full time

    About Us :Fanatics is building a leading global digital sports platform.We ignite the passions of global sports fans and maximize the presence and reach for our hundreds of sports partners globally by offering products and services across Fanatics Commerce, Fanatics Collectibles, and Fanatics Betting & Gaming, allowing sports fans to Buy, Collect, and...

  • Staff Engineer, Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India Nagarro Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're Nagarro.We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world experts across 38 countries, to be exact). Our work culture is dynamic and...

  • Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India Sky Systems, Inc. (SkySys) Full time

    Role:Big Data EngineerPosition Type:Full-Time Contract (40hrs/week)Contract Duration:Long TermWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilledBig Data Engineer (5+ years' experience)to join Experian's dynamic data engineering team. You will design and optimize scalable data pipelines,...

  • Big data engineer

    3 days ago

    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge API Data...

  • Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India.Roles and ResponsibilityDesign and develop scalable big data systems using Pyspark and Azure Data Bricks.Implement and manage...

  • Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India Harp Technologies Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Title: Bigdata + PysparkLocation: HyderabadExperience Level: 5-8 YearsNotice Period: Immediate to 30 DaysInterview Mode: L1 Virtual / L2 F2F (Mandatory)Work Mode: HybridJob SummaryWe are seeking a Specialist with 5 to 8 years of experience in the Big Data Hadoop Ecosystem to design and implement scalable data solutions.Detailed Job DescriptionWork...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Bengaluru, India Fusion Plus Solutions Full time

    Job Description We are looking for a skilled Big Data Engineer with 5 to 7 years of hands-on experience in Big Data technologies. The ideal candidate should have strong expertise in Hadoop, HDFS, Hive, SQL, and Unix, and be able to work on large-scale data processing systems. Roles and Responsibilities: - Work on design, development, and optimization of Big...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India HARP Technologies And Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : - Skill : Bigdata + Pyspark - Location : Hyderabad only - Experience : 5-9 Years - Notice Period : Immediate to 30 Days - Interview Mode : L1 Virtual / L2 F2F (Mandatory) - Work Mode : Hybrid - Skills required : Bigdata (Hadoop Hive, Impala, Spark) , pyspark, Python, Oracle, Exadata (RDBMS),...

  • Big Data QA/Test Engineer

    1 week ago

    Hyderabad, Telangana, India deltaclass technology solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role : Bigdata QA Test Engineer Exp : 6+Yrs Notice :Immediate to 15 Days Location:Hyderabad (Hybrid) Big Data QA/Test engineer – 3 Openings Hyderabad or Chennai (Hybrid) Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS + Data-bricks + Big Data + Python + DevOps Big Data QA/Test Engineer AWS +...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Pennant Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Big Data EngineerDepartment: Data & AnalyticsEmployment Type: Full‑timeRole OverviewWe are seeking an experienced Big Data Engineer to join our growing Data & Analytics team. In this role, you'll design, build, and optimize our modern data platform—enabling scalable pipelines, reliable data lakes, and robust ML operations. You'll work...