Previous Next

    Netflix Open Source Software Center


    Netflix is committed to open source. Netflix both leverages and provides open source technology focused on providing the leading Internet television network. Our technology focuses on providing immersive experiences across all internet-connected screens. Netflix's deployment technology allows for continuous build and integration into our worldwide deployments serving members in over 50 countries. Our focus on reliability defined the bar for cloud based elastic deployments with several layers of failover. Netflix also provides the technology to operate services responsibly with operational insight, peak performance, and security. We provide technologies for data (persistent & semi-persistent) that serve the real-time load to our 62 million members, as well as power the big data analytics that allow us to make informed decisions on how to improve our service. If you want to learn more, jump into any of the functional areas below to learn more.

    Generic placeholder image 1

    Big Data

    Tools and services to get the most out of your (big) data

    Data is invaluable in making Netflix such an exceptional service for our customers. Behind the scenes, we have a rich ecosystem of (big) data technologies facilitating our algorithms and analytics. We use and contribute to broadly-adopted open source technologies including Hadoop, Hive, Pig, Parquet, Presto, and Spark. In addition, we’ve developed and contributed some additional tools and services, which have further elevated our data platform. Genie is a powerful, REST-based abstraction to our various data processing frameworks, notably Hadoop. Inviso provides detailed insights into the performance of our Hadoop jobs and clusters. Lipstick shows the workflow of Pig jobs in a clear, visual fashion. And Aegisthus enables the bulk abstraction of data out of Cassandra for downstream analytic processing.


    Generic placeholder image 1

    Build and Delivery Tools

    Taking code from desktop to the cloud

    Netflix has open sourced many of our Gradle plugins under the name Nebula. Nebula started off as a set of strong opinions to make Gradle simple to use for our developers. But we quickly learned that we could use the same assumptions on our open source projects and on other Gradle plugins to make them easy to build, test and deploy. By standardizing plugin development, we've lowered the barrier to generating them, allowing us to keep our build modular and composable.

    We require additional tools to take these builds from the developers' desks to AWS. There are tens of thousands of instances running Netflix. Every one of these runs on top of an image created by our open source tool Aminator. Once packaged, these AMIs are deployed to AWS using our Continuous Delivery Platform, Spinnaker. Spinnaker facilitates releasing software changes with high velocity and confidence.


    Generic placeholder image 1

    Common Runtime Services & Libraries

    Runtime containers, libraries and services that power microservices

    The cloud platform is the foundation and technology stack for the majority of the services within Netflix. The cloud platform consists of cloud services, application libraries and application containers. Specifically, the platform provides service discovery through Eureka, distributed configuration through Archaius, resilent and intelligent inter-process and service communication through Ribbon. To provide reliability beyond single service calls, Hystrix is provided to isolate latency and fault tolerance at runtime. The previous libraries and services can be used with any JVM based container.

    The platform provides JVM container services through Karyon and Governator and support for non-JVM runtimes via the Prana sidecar. While Prana provides proxy capabilities within an instance, Zuul (which integrates Hystrix, Eureka, and Ribbon as part of its IPC capabilities) provides dyamically scriptable proxying at the edge of the cloud deployment.

    The platform works well within the EC2 cloud utilizing the Amazon autoscaler. For container applications and batch jobs running on Apache Mesos, Fenzo is a scheduler that provides advanced scheduling and resource management for cloud native frameworks. Fenzo provides plugin implementations for bin packing, cluster autoscaling, and custom scheduling optimizations can be implemented through user-defined plugins.


    Generic placeholder image 1

    Content Encoding

    Automated Scalable Multimedia Ingest and Encoding

    One of the great challenges for Netflix is managing the large and numerous audio and video assets at scale. This scale challenge is bounded by Hollywood master files that can be multiple terabytes in size, and cellular audio and video encodes which must provide an excellent customer experience at 200 Kilobits-per-second. As part of the Netflix Digital Supply Chain, our encoding-related open-source efforts focus on tools and technologies that allow us meet the challenges of content ingest, and encoding, at scale.

    Photon is a Java implementation of the Interoperable Master Format (IMF) standard. IMF is a SMPTE standard whose core constraints are defined in the specification st2067-2:2013. VMAF is a perceptual quality metric that out-performs the many objective metrics that are currently used for video encoder quality tests.


    Generic placeholder image 1

    Data Persistence

    Storing and Serving data in the Cloud.

    Handling over a trillion data operations per day requires an interesting mix of “off the shelf OSS” and in house projects. No single data technology can meet every use case or satisfy every latency requirement. Our needs range from non-durable in-memory stores like Memcached, Redis, and Hollow, to searchable datastores such as Elastic and durable must-never-go-down datastores like Cassandra and MySQL.

    Our Cloud usage and the scale at which we consume these technologies, has required us to build tools and services that enhance the datastores we use. We’ve created the sidecars Raigad and Priam to help with the deployment, management and backup/recovery of our hundreds of Elastic and Cassandra clusters. We’ve created EVCache and Dynomite to use Memcached and Redis at scale. We’ve even developed the Dyno client library to better consume Dynomite in the Cloud.


    Generic placeholder image 1

    Insight, Reliability and Performance

    Providing Actionable Insight at Massive Scale

    Telemetry and metrics play a critical role in the operations of any company, and at more than a billion metrics per minute flowing into Atlas, our time-series telemetry platform, they play a critical role at Netflix. However, Operational Insight is considered a higher-order family of products at Netflix, including the ability to understand the current components of our cloud ecosystem via Edda, and the easy integration of Java application code with Atlas via the Spectator library.

    Effective performance instrumentation allows engineers to drill quickly on a massive volume of metrics, making critical decisions quickly and efficiently. Vector exposes high-resolution host-level metrics with minimal overhead.

    Being able to understand the current state of our complex microservice architecture at a glance is crucial when making remediation decisions. Vizceral helps provide this at-a-glance intuition without needing to first build up a mental model of the system.

    Finally to validate reliability, we have Chaos Monkey which tests our instances for random failures, along with the Simian Army.


    Generic placeholder image 1

    Security

    Defending at Scale

    Security is an increasingly important area for organizations of all types and sizes, and Netflix is happy to contribute a variety of security tools and solutions to the open source community. Our security-related open source efforts focus primarily on operational tools and systems to make security teams more efficient and effective when securing large and dynamic environments.

    Security Monkey helps monitor and secure large AWS-based environments, allowing security teams to identify potential security weaknesses. Scumblr is an intelligence gathering tool that leverages Internet-wide targeted searches to surface specific security issues for investigation. Stethoscope is a web application that collects information from existing systems management tools (e.g., JAMF or LANDESK) on a given employee’s devices and gives them clear and specific recommendations for securing their systems.


    Generic placeholder image 1

    User Interface

    Libraries to help you build rich client applications

    Every month, Netflix members around the world discover and watch more than ten billion hours of movies and shows on their TV, mobile and desktop devices. Using modern UI technologies like Node.js, React and RxJS, our engineers build rich client applications that run across thousands of devices. We strive to create cinematic, immersive experiences that delight our members, exhibit exceptional performance and work flawlessly. We're continuously improving the product through data-driven A/B testing that enables us to experiment with novel concepts and understand the value of every feature we ship.

    We created Falcor for efficient data fetching. We help maintain Restify to enable us to scale Node.js applications with full observability. We're helping to build the next version of RxJS to improve its performance and debuggability.

    主站蜘蛛池模板: 国产在线一区二区视频| 狠狠综合久久AV一区二区三区| 一区二区国产精品| 久久久久人妻精品一区| 午夜无码视频一区二区三区| 日本无卡码免费一区二区三区| 久久久综合亚洲色一区二区三区| 亚洲av高清在线观看一区二区| 精品女同一区二区三区在线| 成人精品视频一区二区三区尤物| 3D动漫精品一区二区三区| 极品尤物一区二区三区| 亚洲av无码一区二区三区观看| 亚洲欧洲日韩国产一区二区三区| 久久精品国产AV一区二区三区| 亚洲av福利无码无一区二区| 91精品国产一区| 狠狠做深爱婷婷综合一区| 曰韩精品无码一区二区三区| 日韩免费观看一区| 国产日产久久高清欧美一区| 国内精品视频一区二区三区八戒| 国产一区二区在线| 中文字幕亚洲乱码熟女一区二区 | 天堂资源中文最新版在线一区| 国产一区二区精品| 国产人妖在线观看一区二区| 久久久精品日本一区二区三区| 一区二区三区午夜视频| 国产一区二区三区福利| 91精品一区二区| 国产免费一区二区三区免费视频| 久久精品一区二区三区四区| 免费看无码自慰一区二区| 日本中文字幕一区二区有码在线| 97人妻无码一区二区精品免费| 一区二区国产精品| 日韩一区在线视频| 久久综合亚洲色一区二区三区| 国产福利电影一区二区三区久久久久成人精品综合 | 国产精品主播一区二区|