Big Data Engineer

6 days ago

Bengaluru, Karnataka, India Techno Comp Full time ₹ 20,00,000 - ₹ 25,00,000 per year

JOB RESPONSIBILITY

· Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)

· Write SQL queries to validate the dashboard output

· Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.

· Performing code reviews and pair programming

· Supporting and enhancing current applications

· Design, develop, test, and implement the application investigate and resolve complex issues while supporting existing applications.

QUALIFICATION

· B.Tech /B.E /MCA

EXPERIENCE

· 6+ year's experience in AWS Services: RDS, AWS Lambda, AWS Glue, Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

· 6+ year's experience SQL and NoSQL databases like MySQL, Postgres, Elasticsearch

· 6+ year's experience with Spark programming paradigms (batch and stream-processing)

· 6+ year's experience in Java, Scala. Familiarity with a scripting language like Python as well as Unix/Linux shells

· 6+ year's experience with Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.

SKILLS AND COMPETENCIES

· Profound understanding of Big Data core concepts and technologies – Apache Spark, Kafka, Spark streaming, spark, Scala , Hive and AWS etc.

· Solid experience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR, Glue, Lambda, Athena, and Redshift. Data Engineer (Bigdata, Kafka, Spark streaming, spark, Scala and AWS).

· Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.

· Programming experience with Python/Scala, Shell scripting.

· Experience with DevOps and Continuous Integration/Delivery (CI/CD) concepts and tools such as Bitbucket and Bamboo.

· Good understanding of business and operational processes.

· Capable of Problem / issue resolution, capable of thinking out of the box.

Job Type: Full-time

Benefits:

  • Provident Fund
  • Work from home

Work Location: In person

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 16,00,000 - ₹ 24,00,000 per year

    We're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India The IT Firm Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    BigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Suzva Software Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hiring: Big Data Engineer (PySpark)Client: [Details will be shared upon shortlisting]Location: Bangalore (Onsite)Experience: 6-8 years (Relevant)Joining: Immediate to 15 days Key Skills: Strong hands-on experience in PySpark Expertise in Big Data technologies Solid understanding of SQL, Data Pipelines, and ETLInterested candidates can share their resume...

  • Big Data Engineer

    18 hours ago

    Bengaluru, Karnataka, India Nagarro Softwares Pvt. Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Associate Staff Engineer, Big Data Engineer (LookML & Looker Studio Pro) Company Description We're Nagarro. We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in...

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Big Data Engineers/Senior Engineers

    2 weeks ago

    Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Big Data Engineer – Spark

    3 days ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Big Data Engineer – Spark & AnalyticsLocation- ( Bangalore, Maharashtra)Job Description•Gather operational intel on business processes and policies from multiple sources•Prepare periodical and ad-hoc reports using operational data•Develop semantic core to align data with business processes•Support operations team's work streams for data processing,...