HN Jobs

Divvit | Big Data Architect/Engineer | REMOTE | Full-time | http://www.divvit.com We are a small startup aiming to make a difference in E-commerce Analytics. Our goal is to provide e-commerce owners all information they need for their businesses to succeed. We are a fully remote company. We have constantly growing number of events coming to our platform. We need an engineer that can build and maintain new streaming and processing system that would allow us to process and store big amount which would be available for real-time analytics requests. Responsibilities: - Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities - Implementing ETL process - Monitoring performance and advising any necessary infrastructure changes Required Skills: - Proficient understanding of distributed computing principles - Ability to solve any ongoing issues with operating the cluster - Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming - Experience with integration of data from multiple data sources - Experience with NoSQL databases, such as MongoDB, HBase or Cassandra - Experience brokers like Kafka or AWS Kinesis - Experience with ElasticSearch - Experience with Amazon Web Services - Understanding of Lambda Architecture It would be awesome if you have: - Experience with Cloudera/MapR/Hortonworks - Experience with Hadoop, HDFS, and querying tools like Pig, Hive, Impala - Experience with Yandex ClickHouse If you are interested, drop me a line: andrei@divvit.com