13 frameworks for mastering machine learning

Deep learning systems have long been tough to work with, due to all the fine-tuning and knob-twiddling needed to get good results from them. Gluon is a joint effort by Microsoft and Amazon Web Services do reduce all that fiddling effort.Gluon works with the Apache MXNet and Microsoft’s Cognitive Toolkit frameworks to optimize deep-learning network training on those systems.[ Go deep into machine learning at InfoWorld: 11 must-have machine learning tools. • 13 frameworks for mastering machine learning • Machine learning pipelines demystified • Review: 6 machine learning clouds • Which Spark machine learning API should you use? ]How Gluon worksNeural networks, like those used in deep learning systems, work in roughly three phases:
The developer hard-codes the behavior of the network.
The developer adjusts how the data is weighted and handled by the network, by changing settings to produce useful results.
The finished network is used to serve … [Read more...] about Gluon brings AI developers self-tuning machine learning

Initially open-sourced in 2012 and followed by its first stable release two years later, Apache Spark quickly became a prominent player in the big data space. Since then, its adoption by big data companies has been on the rise at an eye-catching rate.In-memory processingUndoubtedly a key feature of Spark, in-memory processing, is what makes the technology deliver the speed that dwarfs performance of conventional big data processing. But in-memory processing isn’t a new computing concept, and there is a long list of database and data-processing products with an underlying design of in-memory processing. Redis and VoltDB are a couple of examples. Another example is Apache Ignite, which is also equipped with in-memory processing capability supplemented by a WAL (write-ahead log) to address performance of big data queries and ACID (atomicity, consistency, isolation, durability) transactions.Evidently, the functionality of in-memory processing alone isn’t quite sufficient to … [Read more...] about The rise and predominance of Apache Spark

The AWS Re:invent conference is coming up, and predictions are starting to fly around what Amazon Web Services will announce there. A sure bet is that it will announce some sort of deep learning cloud service. Of course, Google, Microsoft, and IBM won’t be far behind; indeed, both IBM and Microsoft have their own special deep learning projects in the works, called Brainwave and Distributed Deep Learning, respectively.So, what’s the difference between machine learning and deep learning? Simply put, machine learning typically deals with tactical applications of AI, such as making instant predictions. Deep learning provides a foundation for the understanding of massive amounts of patterns or data.[ Go deep into machine learning at InfoWorld: 11 must-have machine learning tools. • 13 frameworks for mastering machine learning • Machine learning pipelines demystified • Review: 6 machine learning clouds • Which Spark machine learning API should you use? … [Read more...] about Now’s the time for enterprises to do deep learning in the cloud

The power of machine learning comes at a price. Once you have the skills, the toolkit, the hardware, and the data, there is still the complexity involved in creating and fine-tuning a machine learning model.But if the whole point of machine learning is to automate tasks that previously required a human being at the helm, wouldn’t it be possible to use machine learning to take some of the drudgework out of machine learning itself?[ Review: TensorFlow, Spark MLlib, Scikit-learn, MXNet, Microsoft Cognitive Toolkit, and Caffe machine learning and deep learning frameworks. | Roundup: 13 frameworks for mastering machine learning. | Cut to the key news and issues in cutting-edge enterprise technology with the InfoWorld Daily newsletter. ]Short answer: a qualified yes. A collection of techniques, under the general banner of “automated machine learning,” or AML, can reduce the work needed to prepare a model and refine it incrementally to improve its accuracy.Automated machine … [Read more...] about 6 machine learning projects to automate machine learning