Cloudera based in Palo Alto is a fast growing provider of open source software development product based on Hadoop. Cloudera is a well funded, fast growth private firm, which is growing rapidly. We are the leader in providing Hadoop to enterprise leading firms as well as well known web 2.0 organizations in the market.
Senior Distributed Systems Engineer (background should include significant experience in scalable distributed systems)
Cloudera is looking for a Senior Systems Engineer who wants to own major components of our data processing platform designed for petabytes of data. You will be dedicated to systems architecture, capacity, security, stability, and data flow issues throughout our high performance data pipelines. An analytical approach with deep understanding of all computer system layers is critical for success in this role.
Responsibilities
Build large distributed systems that scale well – to petabytes of data and tens of thousands of nodes.
Understand performance bottlenecks, failure points, and security holes in such large scale systems, then design and implement software that avoids them.
Develop tools that automate the operations, administration, and tuning of large Hadoop clusters.
Develop tools that facilitate the tuning, development, debugging, and profiling of jobs running on such large clusters.
Develop tools to enable the development and optimization of data work flow pipelines on top of Hadoop clusters.
Profile and optimize large Hadoop clusters, at the application, operating system, file system, server and network levels.
Administer application-level knowledge of back-end systems architecture, as well as contribution to the overall design to monitor and sustain our high standards of availability, security and performance
Qualifications
4+ years software development experience with a highly-scalable, distributed, large multi-node environment (1000+ nodes)
6+ years of Unix environment experience (Red Hat Linux, FreeBSD) including shell scripting
Extensive software development experience in C++, Java, and Python (Django is a strong plus)
Custom network monitoring and application instrumentation experience
System performance debugging and kernel forensics experience
Strong troubleshooting and performance tuning skills (TCP/IP, DNS, File system, Load balancing, etc)
Sufficient understanding of Grid computing, Map-Reduce, advanced server clustering and distributed programming
Strong knowledge of RDBMS concepts and SQL
Knowledge of file system, kernel and database internals – latency, throughput, reliability, availability, consistency, security, etc.
Familiarity with the issues surrounding cross data center replication.
Familiarity with virtual machine technologies
Systems monitoring and management for grid computing.
Provisioning and operating a large-scale compute/storage systems.
Working knowledge of distributed file systems (development knowledge is a strong plus).
Excellent communication skills
Cloudera is a leader in the innovative technology of Hadoop and growing rapidly. We offer a very competitive salary and valuable stock options in our firm. If you are truly striving to make a difference in technology, take on major challenge, and advance your career, please send your information to herbnj@gmail.com
------------------------------------
********************************************************************
Read the new KIT List blog at www.kitlist.wordpress.com for job tips and to connect to our community!
Please go to www.KITlist.org to join, post jobs, or get answers to common questions. If you have any comments or questions, you can reach us directly at KITtechmoderator@KITlist.org.
By using the KIT List you agree to comply with the Terms of Use on the site, and will not use discriminatory employment practices. The KIT List is a service of Connelly Communications, Inc.
TO UNSUBSCRIBE:
Replying to KIT emails with an "unsubscribe" request does not work.
Instead, just send an email (from the same account you used to subscribe) to KITlist-Tech-unsubscribe@yahoogroups.com. If you are still receiving emails after a few days, please email us at KITtechmoderator@KITlist.org and we will manually remove you. Thanks!
Yahoo! Groups Links
<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/KITlist-Tech/
<*> Your email settings:
Individual Email | Traditional
<*> To change settings online go to:
http://groups.yahoo.com/group/KITlist-Tech/join
(Yahoo! ID required)
<*> To change settings via email:
KITlist-Tech-digest@yahoogroups.com
KITlist-Tech-fullfeatured@yahoogroups.com
<*> To unsubscribe from this group, send an email to:
KITlist-Tech-unsubscribe@yahoogroups.com
<*> Your use of Yahoo! Groups is subject to:
http://docs.yahoo.com/info/terms/
No comments:
Post a Comment