CouchDB Cassandra Spark Engineer

CouchDB Cassandra Spark Engineer needs 5+ years experience CouchDB CouchDB CouchDB Cassandra Spark Engineer requires:

• Expertise building data and processing pipelines

• Familiarity with Spark engine syntax modules, including Spark SQL

• Familiarity with APIs including RDD, DataFrame, Dataset, and PySpark

• Fluency in programming languages including Python, Java, and Scala

• Knowledge of Spark internals and streaming technology (Kafka, KSQL, etc.)

• Expertise in SQL and big data processing (Hadoop ecosystems, Hive, Impala, Druid, etc.)

• Familiarity with machine learning algorithms and foundations such as PyTorch

• Experience with an ETL tool and expertise in managing the post-loading data

• Expert in one or more distributed file systems, such as HDFS, S3, and Ceph

• Familiarity with visualization tools

• Familiarity with Amazon's AWS for building Apache Spark clusters

CouchDB Cassandra Spark Engineer duties:

• Provide technical, analytical knowledge and resolving technical challenges throughout project delivery.

• Review code, testing case reviews, and ensuring that the code created matches the requirements are all part of the process.

• Work proactively, autonomously, and collaboratively with global teams to solve project requirements and define issues/challenges with sufficient lead time to mitigate project delivery