Tagged | big-data

• Presentation: Gimel: PayPal’s Analytics Data Platform

  (www.infoq.com)

  #SQL #analytics #big-data #storage

• Introducing Commute Time for Jobs

  (engineering.linkedin.com)

  #data-pipeline #big-data #GeoData #maps

• Solr: Improving performance for Batch Indexing

  (blog.box.com)

  #performance #distributed-systems #big-data #apache-solr

• How Microservices Could Save Medical IoT

  (nordicapis.com)

  #IoT #microservices #big-data #biotech

• Apache Spark - Performance

  (blog.scottlogic.com)

  #performance #distributed-systems #apache-spark #big-data

• Data Retrieval and Cleaning: Tracking Migratory Patterns

  (www.dataquest.io)

  #data-science #big-data

• Centrifuge: a reliable system for delivering billions of events per day

  (segment.com)

  #scaling #big-data #backend #event-driven

• Structure & Attribute Based Graph Partitioning

  (medium.com)

  #algorithms #big-data #graph-processing

• Looking under the hood of the Eventbrite data pipeline!

  (www.eventbrite.com)

  #data-pipeline #software-architecture #big-data #backend

• Exploring The GitHub Archive

  (blog.wallaroolabs.com)

  #stream-processing #big-data #python

• Balanced Partitioning and Hierarchical Clustering at Scale

  (ai.googleblog.com)

  #algorithms #big-data #graph-processing #research

• Utilizing MapReduce Combiners and HyperLogLog++ to process millions of queries over datasets with billions of records

  (liveramp.com)

  #data-pipeline #big-data

• Then and Now: The Rethinking of Time Series Data at Wayfair

  (tech.wayfair.com)

  #software-architecture #noSQL #time-series #big-data

• Introducing Semantic Experiences with Talk to Books and Semantris

  (research.googleblog.com)

  #deep-learning #big-data #text-analysis

• Simon Moss on using artificial intelligence to fight financial crimes

  (www.oreilly.com)

  #AI #data-analytics #big-data #podcast

• Give Meaning to 100 billion Events a Day - The Analytics Pipeline at Teads

  (highscalability.com)

  #data-analytics #big-data #event-queue

• Scaling Uber’s Hadoop Distributed File System for Growth

  (eng.uber.com)

  #scaling #big-data #hadoop #filesystem

• Extracting Signals From the News

  (eng.datafox.com)

  #data-analytics #big-data #text-analysis

• A brief introduction to two data processing architectures — Lambda and Kappa for Big Data

  (towardsdatascience.com)

  #data-pipeline #big-data

• Search Federation Architecture at LinkedIn

  (engineering.linkedin.com)

  #search #big-data

• The Evolution of Data at Reddit

  (redditblog.com)

  #big-data #data-center

• Data Analysis with Spark

  (jobs.zalando.com)

  #data-analytics #apache-spark #big-data

• Under the hood: Suicide prevention tools powered by AI

  (code.facebook.com)

  #deep-learning #machine-learning #big-data #text-analysis

• A Cornucopia of Area Rugs: Will a Diverse Set of Choices Help Customers Find More of What They Love?

  (tech.wayfair.com)

  #data-science #search #big-data

• How to hack Spark to do some data lineage

  (blog.octo.com)

  #data-pipeline #apache-spark #big-data #hadoop

• Creating a musical (data) pipeline

  (devblog.songkick.com)

  #data-pipeline #big-data

• Mis-employing radar charts to distinguish multidimensional data

  (towardsdatascience.com)

  #data-visualisation #big-data

• How to add full text search to your website

  (medium.com)

  #search #big-data #elastisearch

• Cross-Lingual End-to-End Product Search with Deep Learning

  (jobs.zalando.com)

  #deep-learning #search #big-data #text-analysis

• Dynamometer: Scale Testing HDFS on Minimal Hardware with Maximum Fidelity

  (engineering.linkedin.com)

  #distributed-systems #big-data #hadoop

• From big data to fast data

  (www.oreilly.com)

  #data-pipeline #analytics #big-data

• Using Synthetic Data Modeling to Enhance Machine Learning

  (engineering.salesforce.com)

  #machine-learning #data-analytics #big-data

• Caviar’s Word2Vec Tagging For Menu Item Recommendations

  (medium.com)

  #big-data #text-analysis #word2vec

• Time Series Forecasting with Splunk. Part I. Intro & Kalman Filter.

  (towardsdatascience.com)

  #machine-learning #data-analytics #time-series #big-data

• Scaling Time Series Data Storage — Part I

  (medium.com)

  #DBMS #scaling #time-series #big-data

• PageRank in Spark

  (developers.soundcloud.com)

  #search #apache-spark #big-data

• Omphalos, Uber’s Parallel and Language-Extensible Time Series Backtesting Tool

  (eng.uber.com)

  #machine-learning #data-analytics #time-series #big-data

• Fishing for graphs in a Hadoop data lake

  (www.oreilly.com)

  #big-data #hadoop #graph

• Mapping Medium’s Tags

  (medium.engineering)

  #machine-learning #big-data #text-analysis #word2vec

• Faster E-commerce Search

  (www.ebayinc.com)

  #DBMS #search #performance #big-data

• The frequency of tags on Stack Overflow

  (towardsdatascience.com)

  #data-visualisation #analytics #big-data

• Evolving search recommendations on Pinterest

  (medium.com)

  #search #big-data #recommender

• The Art of Effective Visualization of Multi-dimensional Data

  (towardsdatascience.com)

  #data-science #big-data #visualisation

• Bad Design Is Bad for Your Health: Why Data Visualization Details Matter

  (engineering.cerner.com)

  #data-visualisation #big-data

• Big Data: Information visualization techniques

  (towardsdatascience.com)

  #data-analytics #data-visualisation #big-data

• Out of Core Genomics

  (towardsdatascience.com)

  #data-analytics #big-data #biotech

• Large-Scale Health Data Analytics with OHDSI

  (blog.cloudera.com)

  #DBMS #data-analytics #big-data

• How machine learning will accelerate data management systems

  (www.oreilly.com)

  #machine-learning #DBMS #big-data #podcast

• Hadoop Delegation Tokens Explained

  (blog.cloudera.com)

  #big-data #hadoop #data-center #tokens

• DeepVariant: Highly Accurate Genomes With Deep Neural Networks

  (research.googleblog.com)

  #deep-learning #big-data #research #biotech

• [Episode 01] Airbnb, Machine Learning & the Future of Travel

  (mesosphere.com)

  #data-science #AI #machine-learning #big-data #podcast

• Incremental Data Capture for Oracle Databases at LinkedIn: Then and Now

  (engineering.linkedin.com)

  #data-pipeline #infra #big-data #backend

• Dali Views: Functions as a Service for Big Data

  (engineering.linkedin.com)

  #data-pipeline #software-architecture #big-data

• Rebuilding the Segment Leaderboards Infrastructure — Part 3: Design of the New System

  (medium.com)

  #stream-processing #apache-kafka #big-data #backend #cassandra

• The Global Heatmap, Now 6x Hotter

  (medium.com)

  #data-visualisation #analytics #big-data #maps

• Big Data Processing at Spotify: The Road to Scio (Part 1)

  (labs.spotify.com)

  #data-pipeline #big-data #scala

• Airflow: The Missing Context

  (hackernoon.com)

  #data-science #big-data #crawling

• Using Kafka Streams API for predictive budgeting

  (medium.com)

  #data-pipeline #stream-processing #apache-kafka #big-data

• Big Dataset: All Reddit Comments – Analyzing with ClickHouse

  (www.percona.com)

  #analytics #big-data #visualisation

• One Million Tables in MySQL 8.0

  (www.percona.com)

  #scaling #MySql #big-data

• The Search for Better Search at Reddit - Because, certainly, we’ve solved it this time

  (redditblog.com)

  #software-architecture #infra #search #big-data

• Exploring and Visualizing an Open Global Dataset

  (research.googleblog.com)

  #AI #machine-learning #data-analytics #big-data

• Steering oceans of content to the world

  (code.facebook.com)

  #data-pipeline #infra #big-data #backend

• IMDb Data in a Graph Database

  (www.percona.com)

  #big-data #graph-processing #graphDB

• Implementing Temporal Graphs with Apache TinkerPop and HGraphDB

  (blog.cloudera.com)

  #noSQL #data-analytics #big-data #graph-processing

• Breaking the “curse of dimensionality” in Genomics using “wide” Random Forests

  (databricks.com)

  #noSQL #data-analytics #big-data

• Building the Activity Graph, Part 2

  (engineering.linkedin.com)

  #noSQL #big-data #graph-processing

• BigDB - an ad data pipeline for LINE

  (engineering.linecorp.com)

  #data-pipeline #infra #DBMS #big-data

• Engineering Data Analytics with Presto and Parquet at Uber

  (eng.uber.com)

  #software-architecture #infra #data-analytics #big-data