Big Data Tester

2 weeks ago


Chennai, India Durus Consulting Private Limited Full time

**JOB DESCRIPTION FOR BIG DATA ENGINEER**

**Job Role ** : Big Data Testing

**Job Type** : FTE

**Location** : Hybrid

**Notice Period** : Immediate to 30 days

**Experience ** : 3+ YRS

**Desired Skills and Experience.**
- Demonstrated testing & automation experience of 3-6 Years in Big data technology stack - Hadoop, HDFS & Spark
- Good understanding of Hive concepts and knowledge of NoSQL DB preferable
- Proficient in writing complex SQL, Hive QL and Spark QL queries
- Ability to test software & get UAT done from business users in Agile manner
- Continuous automation to increase test coverage and efficiency
- Proactive & reactive support in deployments & production environment
- Expert in one of the scripting languages such as Python/Shell/Perl.
- Hands on experience in Linux or Unix
- Good debugging skills
- Proficient understanding of distributed computing principles
- Management of Hadoop cluster and spark, with all included services
- Ability to solve any ongoing issues with operating the cluster
- Proficiency with Hadoop v2, MapReduce, HDFS
- Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
- Experience with integration of data from multiple data sources
- Experience with NoSQL databases, such as HBase, MongoDB
- Added advantage with BI tools like PowerBI and Tableau
- Knowledge of various ETL techniques and frameworks, such as Flume
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Experience with Big Data ML toolkits, such as Mahout, SparkML
- Good understanding of Lambda Architecture, along with its advantages and drawback

**Job Types**: Full-time, Regular / Permanent

**Salary**: ₹291,203.91 - ₹1,000,000.00 per year

Schedule:

- Day shift
- Morning shift

Ability to commute/relocate:

- Chennai, Chennai - 600096, Tamil Nadu: Reliably commute or planning to relocate before starting work (required)

**Education**:

- Bachelor's (preferred)

**Experience**:

- Big data: 4 years (required)
- SQL: 1 year (required)
- Hadoop: 1 year (required)
- HDFS: 1 year (required)
- Cloud: 1 year (required)

**Speak with the employer**
+91 7200098547


  • Big Data Architect

    3 weeks ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big Data Architect

    4 weeks ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Big Data Architect

    4 weeks ago


    chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...


  • Chennai, India Databricks Full time

    CSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...


  • chennai, India Databricks Full time

    CSQ125R88 As an Architect (Big Data) in our Professional Services team you will work with clients on short to medium term customer engagements on their Big Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...


  • Chennai, India Databricks Full time

    CSQ125R88As an Architect (Big Data) in our Professional Services team you will work with clients on short to medium term customer engagements on their Big Data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...

  • Big Data Architect

    1 week ago


    Chennai, India Databricks Full time

    CSQ225R24As aResident Solutions Architectin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Architect

    1 week ago


    chennai, India Databricks Full time

    CSQ225R24 As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Architect

    1 week ago


    Chennai, India Databricks Full time

    CSQ225R24As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...

  • Big Data Architect

    1 month ago


    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    **Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Big Data Developer

    3 weeks ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign, develop, and deploy scalable Big Data applications using Apache Spark.Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data sources...

  • Big Data Developer

    1 month ago


    chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...

  • Big Data Developer

    1 month ago


    Chennai, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...


  • chennai, India Anicalls (Pty) Ltd Full time

    • Cloud Data Analytics (AWS, Oracle, Azure, Snowflake) – Hands-on solution design experience in at least two of cloud platforms.• Experience in growing & mining existing accounts• Experience in implementing at least 4 Cloud Data Analytics & Big Data engagements.• Extensive experience in solution design in complex projects in big data, cloud...

  • Big Data Developer

    3 weeks ago


    Chennai, India Citi Full time

    The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Big Data Developer

    3 weeks ago


    chennai, India Citi Full time

    The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Big Data Developer

    2 weeks ago


    Chennai, India Citi Full time

    The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...

  • Data Engineer

    2 weeks ago


    Chennai, India Mobile Programming LLC Full time

    Job Role : Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills...

  • Data Engineer

    1 month ago


    chennai, India Mobile Programming LLC Full time

    Job Role : Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills and the...

  • Data Engineer

    2 weeks ago


    Chennai, India Mobile Programming LLC Full time

    Job Role :Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills and...