Skip to content

Software Development News: .NET, Java, PHP, Ruby, Agile, Databases, SOA, JavaScript, Open Source

Methods & Tools

Subscribe to Methods & Tools
if you are not afraid to read more than one page to be a smarter software developer, software tester or project manager!

Feed aggregator

Azure HDInsight Clusters Allows Custom Installation of Spark Using Script Action

Apache Spark is a popular open source framework for distributed cluster computing. Spark has been gaining popularity for its ability to handle both batch and stream processing as well as supporting in-memory and conventional disk processing. Starting today, Azure HDInsight will make it possible to install Spark as well as other Hadoop sub-projects on its clusters. This is delivered through a new customization feature called Script Action. This will allow you to experiment and deploy Hadoop projects to HDInsight clusters that were not possible before. We are making this easier specifically for Spark and R by documenting the process to install these modules.

To do this, you will have to create an HDInsight cluster with Spark Script Action. Script Action allow users to specify PowerShell scripts that will be executed on cluster nodes during cluster setup. One of the sample scripts that are released with the preview is Script Action to install Spark. During preview the feature is available through PowerShell, so you will need to run PowerShell scripts to create your Spark cluster. Below is the snippet of the PowerShell code where “spark-installer-v01.ps1” is the Script Action that installs Spark on HDInsight:

New-AzureHDInsightClusterConfig -ClusterSizeInNodes $clusterNodes

| Set-AzureHDInsightDefaultStorage -StorageAccountName $storageAccountName 
        -StorageAccountKey $storageAccountKey -StorageContainerName $containerName

| Add-AzureHDInsightScriptAction -Name "Install Spark"
        -ClusterRoleCollection HeadNode,DataNode
        -Uri https://hdiconfigactions.blob.core.windows.net/sparkconfigactionv01/spark-installer-v01.ps1

| New-AzureHDInsightCluster -Name $clusterName -Location $location

Once the cluster is provisioned it will have the Spark component installed on it. You can RDP into the cluster and use Spark shell:

  • In Hadoop command line window change directory to C:\apps\dist\spark-1.0.2
  • Run the following command to start the Spark shell.

.\bin\spark-shell

  • On the Scala prompt, enter the spark query to count words in a sample file stored in Azure Blob storage account:

val file = sc.textFile("example/data/gutenberg/davinci.txt")
val counts = file.flatMap(line => line.split(" ")).map(word => (word, 1)).reduceByKey(_ + _)
counts.toArray().foreach(println)

Read more on installing and using Spark on HDInsight here:

Read more on Script Action to make other customizations here :

For more information on Azure HDInsight:

Categories: Database

ScrumDay Oviedo, Oviedo, Spain, December 13 2014

Scrum Expert - Mon, 11/17/2014 - 17:55
ScrumDay Oviedo is a one-day conference focused on Scrum and Agile software development that takes place in the Spanish city of Oviedo. All the presentations are in Spanish. In the agenda of ScrumDay Oviedo you can find topics like Agile adoption, team coaching, technical best practices and product ownership. Web site: http://www.scrumdayoviedo.com/ Location for the 2014 conference: Auditorio – Palacio de Congresos “Príncipe Felipe”, Plaza Gesta, 33007 Oviedo, Asturias, Spain
Categories: Agile

An Introduction to Logentries Community Packs By @TrevParsons [#DevOps]

Latest News from AJAX & RIA Journal - Mon, 11/17/2014 - 17:45
We have built our new Community Pack technology as a way for small or large communities to share methods to extract the important information generated by their systems and technology.

read more

Categories: Media, RIA

.NET Foundation Gets New Advisory Council, More Projects

Devx: Latest Published Articles - Mon, 11/17/2014 - 17:44
The open source organization now oversees more than 30 projects.
Categories: Media

Requs

Software Development Tools Directory - Mon, 11/17/2014 - 16:47
As a controlled natural language (CNL) Requs enables the creation of such documents in plain text format. Requs resembles English but has a very strict syntax and semantic.
Categories: Vendor

Mitel Withdraws $574 Million Proposal for ShoreTel

eWeek - Application Development - Mon, 11/17/2014 - 16:45
Mitel executives blame the decision on the refusal by ShoreTel directors to engage in any discussions around a possible deal.
Categories: Media

Electrolyte

Software Development Tools Directory - Mon, 11/17/2014 - 16:44
Electrolyte is a simple, lightweight inversion of control (IoC) container for Node.js applications. Electrolyte automatically wires together the various components and services needed by an application. It does this using a technique known as dep ...
Categories: Vendor

Webroot Updates SecureAnywhere Mobile Protection Platform

eWeek - Application Development - Mon, 11/17/2014 - 16:00
Webroot also offers a app for Apple iOS devices to provide security for iPhones and iPads and includes lost device protection.
Categories: Media

Xerox Invests in Health IT Specialist HealthSpot

eWeek - Application Development - Mon, 11/17/2014 - 15:30
The investment is designed to help deliver telehealth to patients in locations nationwide, including retail pharmacy stores like RiteAid.
Categories: Media

Nvidia Releases Next-Generation Tesla GPU Accelerators

eWeek - Application Development - Mon, 11/17/2014 - 15:20
The new K80 offers twice the performance and memory bandwidth of the current K40, and is being leveraged by HP, Dell and other system makers.
Categories: Media

IT Budget Planning for Big Data

Database Journal News - Mon, 11/17/2014 - 09:01

Big data software, hardware, application suites, business analytics solutions ... suddenly, it seems, IT enterprises are deluged with vendor offerings that solve problems it didn't know it had. As you dive into what will most likely be your largest IT project of the year, ensure that you have planned and budgeted for the following items that are unique to big data implementations.

Categories: Database

Projects of the Week, November 17, 2014

SourceForge.net: Front page news - Mon, 11/17/2014 - 07:08

Here are the featured projects for the week, which appear on the front page of SourceForge.net:

simutrans

Simutrans is a cross-platform simulation game where players try to successfully manage transportation systems between places by land, air, and water for passengers, mail, and goods. Planes, ships, trains, trams, trucks, buses, or monorails are at your disposal, but factories operate based on contracts and passengers can only travel to their set destinations.

[ Download simutrans ]

GnuCash

GnuCash is a personal and small-business finance manager with a check-book like register GUI to enter and track bank accounts, stocks, income, and expenses. GnuCash is designed to be simple and easy to use but still based on formal accounting principles.

[ Download GnuCash ]

Roundcube Webmail

Roundcube Webmail is a browser-based, multilingual IMAP client with an application-like user interface. Roundcube provides the full functionality you’d expect from an email client, including MIME support, address book, folder manipulation, message searching, and spell check. Roundcube is written in PHP and JavaScript.

[ Download Roundcube Webmail ]

gnuplot development

A famous scientific plotting package, features include 2D and 3D plotting, a huge number of output formats, interactive input or script-driven options, and a large set of scripted examples.

[ Download gnuplot development ]

Cyberfox

Cyberfox is a Mozilla-based Internet browser designed to take advantage of 64-bit architecture but a 32-bit version is also available. The application provides a higher performance when navigating your favorite pages. Compatible With Windows Vista x64, Windows 7 x64, Windows 8/8.x OS. Cyberfox uses windows 8 SDK.

[ Download Cyberfox ]

winPenPack: Portable Software Collection

winPenPack is a project that aims at collecting the most frequently used and most popular open source applications made portable, so that they can be executed without installation from any USB Flash Drive or Hard Disk. The winPenPack suites offer a wide range of portable applications like office tools, internet tools, multimedia tools, development tools, security applications and other frequently used utilities. Everything you need, completely free, open source and portable!

[ Download winPenPack: Portable Software Collection ]

OS X Portable Applications

OS X FOSS portable applications are packaged so you can carry around on any portable device, USB thumb drive, iPod, portable hard drive, memory card, other portable device (or also on your internal hard disk), taking your preferences with you.

[ Download OS X Portable Applications ]

Clam AntiVirus

Clam AntiVirus is a GPL antivirus toolkit for UNIX. The main purpose of this software is the integration with mail servers. It provides a flexible and scalable multi-threaded daemon, a command line scanner and a virus database that is kept up-to-date.

[ Download Clam AntiVirus ]

FileBot

FileBot is the ultimate tool for renaming your movies, tv shows or anime and downloading subtitles. It’s smart, streamlined for simplicity and just works. FileBot supports Windows, Linux and Mac, plus there’s a full-featured command-line interface for all sorts of automation.

[ Download FileBot ]

Categories: Open Source

“Community Choice” Project of the Month Vote – January 2015

SourceForge.net: Front page news - Mon, 11/17/2014 - 02:45

The vote for January 2015 Community Choice SourceForge Project of the Month is now available, and will run until Dec 15, 2014 12:00 UTC:

Vote here for the Community Choice SourceForge Project of the Month for January 2015

 

Alt-F

Alt-F provides a free alternative firmware for the DLINK DNS-320/320L/321/323/325. Alt-F has Samba and NFS; supports ext2/3/4, VFAT, NTFS and ISO9660 filesystems; RAID 0, 1, 5 (with external USB disk) and JBOD; supports 2/3/4TB disks; rsync, ftp, sftp, ftps, ssh, lpd, DNS and DHCP servers, DDNS, fan and leds control, clean power up and down, and more.

[ Download Alt-F ]

GnuCash

GnuCash is a personal and small-business finance manager with a check-book like register GUI to enter and track bank accounts, stocks, income, and expenses. GnuCash is designed to be simple and easy to use but still based on formal accounting principles.

[ Download GnuCash ]


gnuplot

A famous scientific plotting package, features include 2D and 3D plotting, a huge number of output formats, interactive input or script-driven options, and a large set of scripted examples.

[ Download gnuplot ]

ScummVM

ScummVM is a cross-platform interpreter for many point-and-click adventure games. This includes LucasArts SCUMM games (such as Monkey Island 1-3, Day of the Tentacle, Sam & Max, …), many of Sierra’s AGI and SCI games (such as King’s Quest 1-6, Space Quest 1-5, …), Discworld 1 and 2, Simon the Sorcerer 1 and 2, Beneath A Steel Sky, Lure of the Temptress, Broken Sword 1 and 2, Flight of the Amazon Queen, Gobliiins 1-3, The Legend of Kyrandia 1-3, many of Humongous Entertainment’s children’s SCUMM games (including Freddi Fish and Putt Putt games) and many more.

[ Download ScummVM ]

OS X Portable Applications

OS X FOSS portable applications are packaged so you can carry around on any portable device, USB thumb drive, iPod, portable hard drive, memory card, another portable device, or on your internal hard disk so you can take your preferences with you.

[ Download OS X Portable Applications ]

SharpDevelop

SharpDevelop is the open-source IDE for the .NET platform. Write applications in languages including C#, VB.NET, F#, IronPython, and IronRuby, as well as target rich and reach: Windows Forms or WPF, as well as ASP.NET MVC and WCF. It starts from USB drives, supports read-only projects, comes with integrated unit and performance testing tools, Git, NuGet, and a lot more features that make you productive as a developer.

[ Download SharpDevelop ]

gretl

gretl is a cross-platform software package for econometric analysis, written in the C programming language.

[ Download gretl ]

ZABBIX

ZABBIX is an enterprise-class open source distributed monitoring solution designed to monitor and track performance and availability of network servers, devices, and other IT resources. It supports distributed and WEB monitoring, auto-discovery, and more. An enterprise-class distributed monitoring solution for networks and apps.

[ Download ZABBIX ]

PostInstallerF

PostInstallerF will install all the software that Fedora doesn’t include by default, after running Fedora for the first time. It’s easy for a new user. PostInstallerF contains everything that you need for your daily computing.

Categories: Open Source

Rapise v2.2 Released

Inflectra News - Mon, 11/17/2014 - 01:00
We have just released v2.2 of our Rapise test automation system. The latest version fixes some issues identified when recording using Firefox and optimizes playback support using Chrome and Firefox. It also includes support for CSS-based locators.
Categories: Vendor

‘Pay-As-You-Go Model’ Presentation Slides By @VerizonAnne | @CloudExpo

Java Developer's Journal - Sun, 11/16/2014 - 23:00
In her General Session at 15th Cloud Expo, Anne Plese, Senior Consultant, Cloud Product Marketing, at Verizon Enterprise, focused on finding the right mix of renting vs. buying Oracle capacity to scale to meet business demands, and offer validated Oracle database TCO models for Oracle development and testing environments. Anne Plese is a marketing and technology enthusiast/realist with over 19+ years in high tech. At Verizon Enterprise, she focuses on driving growth for the Verizon Cloud platform globally. Previous to Verizon, Anne spent over 10 years with Cisco. There she was focused on growing Cisco's global data center and cloud revenue, and boosting market awareness and affinity for Cisco data center solutions within the Enterprise and Commercial market segments.

read more

Categories: Java, Media

.NET Foundation Adds New Governance Model, Projects

eWeek - Application Development - Sun, 11/16/2014 - 17:30
The .NET Foundation is moving to a new governance model to help with its oversight of Microsoft's open-sourcing of the .NET development environment.
Categories: Media

Dell Research Works at Intersection of Technology, Customer Needs

eWeek - Application Development - Sun, 11/16/2014 - 17:30
The recent Dell World show focused in part on the work being done by the company's research unit on cloud infrastructure, security and mobility.
Categories: Media

AT&T Pulls Back on Fiber to 100 U.S. Cities Over Net Neutrality Fight

eWeek - Application Development - Sun, 11/16/2014 - 17:25
While the FCC, President Obama and other officials figure out what net neutrality road to take, AT&T says it will stop spending on fiber network installs in 100 U.S. cities until the rules are set.
Categories: Media

Mobile Pwn2own Hackers Exploit NFC, Browsers and More

eWeek - Application Development - Sun, 11/16/2014 - 17:23
NEWS ANALYSIS: Information gleaned from the Mobile Pwn2own event—what was and what wasn't exploited—could help improve mobile security in the future.
Categories: Media

2014-11-16 - NEW MODULE: Uize.Widgets.RatingStars.Widget

UIZE JavaScript Framework - Sun, 11/16/2014 - 09:00
The new Uize.Widgets.ImagePort.Widget module implements a widget class for a rating stars widget.
Categories: Open Source, RIA