Netscribes - Data Engineer - Hadoop/Python

2 weeks ago


Bengaluru, India Netscribes Full time

About Us :Were a global leader in providing strategic data and insights to help companies accelerate growth. Founded in 2000, we work with Fortune 500 companies and high-growth startups across sectors like eCommerce, healthcare, technology, and financial services. Our solutions include business research, content services, data analytics, data engineering, and AI/ML.Key Responsibilities :- Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increase data accessibility and fostering data-driven decision making across the organization.- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.- Writes unit/integration tests, contributes to engineering wiki, and documents work.- Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.- Works closely with a team of front-end and backend engineers, product managers, and analysts.- Defines company data assets (data models), spark, spark SQL, and hive SQL jobs to populate data models.- Designs data integrations and data quality framework.Required Skills & Qualifications :- BS or MS degree in Computer Science or a related technical field- 5+ years of experience with Hive, Hadoop, Spark, and data warehouse design- Hands-on experience in Python, SQL, and PySpark- Exposure to AWS (S3, EMR) or Azure environments- Familiarity with DevOps and automation (CI/CD, Docker, etc.)- Experience working with enterprise reporting and data compliance use cases (ref:hirist.tech)



  • Bengaluru, Karnataka, India NETSCRIBES DATA INSIGHTS Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About Netscribes : Netscribes is a global market intelligence and content services provider that helps corporations achieve strategic objectives through a wide range of offerings. Our solutions rely on a unique combination of qualitative and quantitative primary research, secondary/desk research, social media analytics, and IP research. For more...


  • Bengaluru, Karnataka, India NETSCRIBES DATA INSIGHTS Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Netscribes : Netscribes is a global market intelligence and content services provider that helps corporations achieve strategic objectives through a wide range of offerings. Our solutions rely on a unique combination of qualitative and quantitative primary research, secondary/desk research, social media analytics, and IP research. For more...


  • Bengaluru, India NETSCRIBES DATA INSIGHTS Full time

    - We are seeking a driven Project Manager to oversee and drive AI & Emerging Technology initiatives within our organization.- This role combines project management, client engagement, and technology adoption, with a focus on leveraging AI, Agentic AI, Machine Learning, Data Analytics, and other emerging tech solutions to solve real business problems. Key...

  • Hadoop Admin

    1 week ago


    Bengaluru, India NTT DATA Full time

    **Req ID**: 205548 We are currently seeking a Hadoop Admin to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Hadoop Admin: Around 5 years of Experience - Deploy the Hadoop File System (HDFS), and peripheral technologies in its ecosystem (HDFS, Hive, Pig, Hbase) using both automated toolsets as well as manual processes. - Maintain, support, and...


  • Bengaluru, India Rackspace Technology Full time

    Job Description We are hiring for Big Data / Hadoop Engineer Exp - 3+yrs Location - Bangalore ( 3days WFO) Notice Period - Less than 30days only . Big Data Development:Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem. . Programming & Scripting:Develop complex data processing...


  • Bengaluru, India Tehno Right Full time

    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...


  • Bengaluru, Karnataka, India NETSCRIBES DATA INSIGHTS Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role : Golang Sr Developer Employment Type : Permanent Work Mode : Hybrid/WFO Working Days : 5 days (Sat-Sun week off) Shift : Fixed Shift (9 hours) Shift Timings : General Shift Location : BengaluruSalary : hike on last withdrawn salaryKey Responsibilities : - Develop and design software applications, translating user needs into system...


  • Bengaluru, India Ziniosedge Full time

    9 yrs to 12 yrs Python, Java, SQL, BIG Data, Hadoop, Oracle DB Python, Java, SQL, BIG Data, Hadoop, Oracle DB

  • Data Engineer

    3 days ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...


  • Bengaluru, Pune, India Tech Mahindra Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Responsibilities:Onboarding and updating data deliveries on our Hadoop Datalake• Developing frameworks to process and deploy new data delivery methods or file formats (JSON, XML, CSV, ProtoBuf, Avro, Parquet, etc)• Creating views and tables for our users with optimal performance for their use case• Experience of connecting and interfacing with systems...