Big Data Developer-5+ Years

1 day ago


Bengaluru, Karnataka, India Cortex Consultants Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Senior Big Data Developer
Location - Bangalore
Exp- 5 to 10 years
 JD:
• Design, develop, and maintain scalable data pipelines and systems using Apache Spark, Databricks, and SQL.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize and tune data processing workflows for performance and scalability.
• Implement data quality checks and ensure data integrity across various data sources.
• Develop and maintain ETL processes to ingest and transform data from multiple sources.
• Monitor and troubleshoot data pipeline issues, ensuring timely resolution.
• Stay up-to-date with the latest industry trends and technologies in data engineering. Requirements:
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering or a related role.
• Strong proficiency in Apache Spark and Databricks.
• Advanced SQL skills, including experience with complex queries and performance optimization.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Proficiency in programming languages such as Python or Scala.
• Familiarity with data warehousing concepts and technologies (e.g., Snowflake, Redshift).
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills. Preferred Qualifications:
• Experience with real-time data processing and streaming technologies (e.g., Kafka, Flink).
• Knowledge of data governance and security best practices.
• Experience with CI/CD pipelines and DevOps practices.
  • Big Data Developer

    1 week ago


    Bengaluru, Karnataka, India Sourcebae Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, Scala Are you a seasonedBig Data Engineerready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with5-8 yearsof experience in the core Big Data ecosystem to deliver high-performance solutions.This is a great opportunity to join a...

  • Big Data Developer

    20 hours ago


    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    L3 Big datadeveloper Years)1. Design, develop, and implement highly scalable and distributed big datasolutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, andSpark.2. Architect HBase schemas and data models to accommodate evolving businessrequirements and ensure optimal performance for data storage and retrievaloperations.3. Develop...

  • Big Data Developer

    19 hours ago


    Bengaluru, Karnataka, India VidPro Consultancy Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Python, pyspark, SQL, DSA, AWS, Hadoop, Hive, Mapreduce and Spark5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and HiveBachelors or masters degree in Computer Science or related fieldStrong knowledge of working with large data sets and high-capacity big data processing platformStrong experience in...

  • Big Data Engineer

    3 days ago


    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...


  • Bengaluru, Karnataka, India Cortex Consultants Full time ₹ 20,00,000 - ₹ 25,00,000 per year

     Total IT / development experience of 3+ years• Experience in Spark (Scala-Spark or PySpark) developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB+B4+A3:B5d technology strategies• Exposure to deploying on Cloud platforms• At least 2 years of development experience on designing and developing Data Pipelines for Data Ingestion or...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Big Data Developer

    2 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Greetings from TCSTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position:Bigdata DeveloperJob Location:BangaloreExperience:6-12 YearsMust...

  • Big Data

    1 day ago


    Bengaluru, Karnataka, India PradeepIT Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the jobAccelerate your career with PradeepITPradeepIT is one of the largest, globally recognized IT Consulting firm to connect Indias deeply vetted talent team to global customer.Were headquartered in Bengaluru, Silicon Valley of India. PradeepITs customers include SAP Lab, Bosch, Rolls-Royce, Daikin, Daimler and J&J and hundreds of other Fortune 500...

  • Big Data Engineer

    7 days ago


    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...

  • Big Data Developer

    2 weeks ago


    Bengaluru, Karnataka, India Infobell IT Full time ₹ 1,20,000 - ₹ 1,80,000 per year

    Job Title:Big Data DeveloperLocation:Bangalore (Work from Office)Experience:5+ YearsNotice Period:Immediate Joiners PreferredAbout Us:Infobell IT is a technology-driven company specializing inproduct engineering,AI,cloud modernization, anddata analytics. We work with leading enterprises to build scalable, high-performance, and cloud-native solutions.Key...