Skip to content

Software Development News: .NET, Java, PHP, Ruby, Agile, Databases, SOA, JavaScript, Open Source

Methods & Tools

Subscribe to Methods & Tools
if you are not afraid to read more than one page to be a smarter software developer, software tester or project manager!

Database

TSQL: Understanding How to Use the INSERT Statement to Populate Your Database Tables

Database Journal News - 12 hours 54 min ago

Before you can read data from your database you need to understand how to insert data into the tables in your database. There are a number of different ways to accomplish this. Greg Larsen explores the methods you can use when inserting data into a database table using the INSERT statement.

Categories: Database

IBM Cognos Proven Practices: IBM Cognos TM1 FEEDERS

IBM - DB2 and Informix Articles - Tue, 09/02/2014 - 05:00
One of the more advanced concepts in the development of IBM Cognos TM1 cubes is the proper implementation of FEEDERS within TM1 rules. This document describes FEEDERS and how to use them effectively for improved performance when building IBM Cognos TM1 cubes.
Categories: Database

DbWrench Database Design 3.2 Released

PostgreSQL News - Sat, 08/30/2014 - 01:00
DbWrench Database Design v3.2 Released

Although version 3.2 did not contain new features it is still a significant release for DbWrench.

The primary focus of this release was to make it Java 8 compatible. This included:

- Upgrading the underlying NetBeans windowing platform. Which should be more responsive.

- Creating a new syntax highlighting SQL editor from the ground up.

A free trial download of this latest version is available at www.dbwrench.com.

Screen shots can be viewed here.

More About DbWrench

DbWrench is designed to increase the productivity of database developers by making creating and modifying databases much easier.

It's features include:

- Graphic entity relation diagram (ERD) designer

    - Forward engineer database designs with automatic SQL DDL script generation

    - Reverse engineer and visualize existing databases

    - A built in syntax highlighting SQL query editor

    - Runs on Windows, Mac OSX and Linux all in a single license
Categories: Database, Open Source

PGConf.EU 2014 schedule posted - Matt Asay to deliver keynote

PostgreSQL News - Thu, 08/28/2014 - 01:00

PostgreSQL Conference Europe is pleased to announce that the schedule for the 2014 event, to be held in Madrid from 21st - 24th October, has now been published.

As well as a wide range of talks for PostgreSQL users, developers and decision makers, we’re pleased to announce that our opening keynote speaker will be Matt Asay, Vice President of Community at MongoDB, who will discuss how PostgreSQL and NoSQL databases can work together, and where each shine on their own.

The schedule is, of course, subject to changes, and a few slots are still empty as we work to confirm the last set of speakers.

PostgreSQL Conference Europe 2014 is the sixth annual PostgreSQL Conference Europe, previous events having been held in cities such as Dublin, Prague and Amsterdam attracting hundreds of PostgreSQL developers and users. For more information and to register, please visit the website.

A discounted "early bird" registration rate is available until 15th September. A discount room rate at the conference hotel is available until 8th September, so we suggest you book your accommodation soon!

We still have seats left at some of the training sessions held the day before the main conference, taught by PostgreSQL experts from around the world, that are subject to availability at a first come first serve basis. See the training section on the website for details.

We look forward to seeing you in Madrid!

Categories: Database, Open Source

PASS Summit 2014 - Don’t miss the largest conference for SQL Server Professionals

Do you have the “Data Gene”? 

Preparations for PASS Summit 2014 in Seattle, Washington are well underway.  We are very excited to have this year’s event back in Seattle and look forward to bringing you some great sessions and activities throughout the event.    

Tune in to this week’s TechNet Radio special to listen to Jennifer Moser, Lara Rubbelke, Ann Bachrach and SQL RockStar, Thomas LaRock talk about the “data gene” and why you don’t want to miss this year’s event.

Don’t procrastinate, get registered for PASS Summit 2014!  

Categories: Database

SQL Server AlwaysOn Offering in Microsoft Azure Portal Gallery

We are excited to announce the release of a SQL Server AlwaysOn template in the Microsoft Azure Portal Gallery. This offering was announced in Scott Guthrie’s blog post along with several other exciting new features.

This template fully automates the configuration of a highly available SQL Server deployment on Azure Infrastructure Services using AlwaysOn Availability Groups.

AlwaysOn Availability Groups

AlwaysOn Availability Groups, released in SQL Server 2012 and enhanced in SQL Server 2014, guarantee high availability for mission-critical workloads. Last year we started supporting Availability Groups on Azure Infrastructure Services. The main components of such a configuration are two SQL Server replicas (a primary and a secondary), and a listener (DNS name). The replicas are configured for automatic failover, and each replica is contained on a distinct Virtual Machine. The listener is a DNS name that client applications can use in their connection string to connect to the current primary replica. The image below shows a depiction of this setup.

 Other components required are a file share witness to guarantee quorum in the configuration to avoid “split brain” scenarios, and a domain controller to join all VMs to the same domain. Similar to the SQL replicas, there is a primary and secondary domain controller to prevent a single point of failure for the domain. The SQL replicas are deployed to an availability set to ensure they are in different Azure failure and upgrade domains. Likewise, the domain controller replicas are in their own availability set. The configuration is depicted in the image below.

 

SQL Server AlwaysOn Template

Setting up the Availability Group configuration requires a long set of steps and a decent time commitment. In order to dramatically simplify this, we have released a SQL Server AlwaysOn template in the Azure Gallery. This template fully automates the configuration of a highly available SQL Server deployment on Azure Infrastructure Services using an Availability Group. Currently, this feature only supports SQL Server 2014 Enterprise images.

The SQL Server AlwaysOn Template, depicted below, is found in the Gallery under “Virtual Machines” and “Recommended”.

 

After selecting it, it will show a description of the configuration that will be created, and the option to specify some arguments. This is depicted in the picture below.

The only arguments required are a Resource Group (an identifier of the deployment) and administrator credentials. From that point on, all settings are optional and will be auto-generated based on these 3 inputs. The domain Sysadmin account, the local SQL Server accounts, and the SQL Server service account password will be auto-generated based on the credentials entered. The names for all resources being created will be based off of what was entered for Resource Group name. The SQL Server service account name and the domain name will be auto-generated but will not be based on the Resource Group name or credentials. If you wish to customize any of these arguments, simply go to the other configurations and change the values entered for any setting. One argument that you may want to change is the Listener name, which your applications will use to connect to SQL Server. By default, entirely new resources will be provisioned for you. You have the option to select an existing domain for the deployment. In future updates, there will be more options to add existing resources to your configuration.

After the template has executed, 5 Virtual Machines will be created under the resource group: 2 Standard A5 VMs for the SQL Server replicas, 2 Standard A1 VMs for the Domain Controller replicas, and 1 Basic A0 VMs for the file share witness. This is depicted below:

You can RDP to one of the SQL Server VMs to see the Availability Group configuration as depicted below:

Try out the SQL Server AlwaysOn Template today by going to the Azure portal: http://portal.azure.com/

Categories: Database

Oracle: Is Parallel Really Necessary?

Database Journal News - Mon, 08/25/2014 - 08:01

You're running processes in parallel; is it really faster?  Sometimes it may not be; read on to see why parallel processing may be creating more work than you'd expect.

Categories: Database

Database .NET 12.6 released

PostgreSQL News - Sat, 08/23/2014 - 01:00

I am happy to announce the new major release of Database .NET 12.6, an innovative, powerful and intuitive multiple database management tool, With it you can Browse objects, Design tables, Edit rows, Export data and Run queries with a consistent interface.

Free, All-In-One, Portable, Standalone (No Installation) and Multlanguage.

Major New features from version 11.1 to 12.6:

The new version is immediately available for download.
Categories: Database, Open Source

Azure previews fully-managed NoSQL database and search services

I am pleased to announce previews of new NoSQL database and search services and the evolution of our Hadoop-based service. Available as previews today are Azure DocumentDB, a fully-managed transactional NoSQL document database-as-a-service, and Azure Search, which enables developers to easily add search capabilities to mobile and cloud applications. Generally available today, Azure HDInsight, our Hadoop-based solution for the cloud, now supports Apache HBase clusters.

With these new and updated services, we’re continuing to make it easier for customers to work with data of any type and size – using the tools, languages and frameworks they want to -- in a trusted cloud environment. From Microsoft products like Azure Machine Learning, Azure SQL Database and Azure HDInsight to data services from our partners, we’re committed to supporting the broadest data platform so our customers get data benefits, in the cloud, on their terms.

Preview of Azure DocumentDB

Applications today must support multiple devices, multiple platforms with rapid iterations from the same data source, and also deliver high-scale and reliable performance. NoSQL has emerged as the leading database technology to address these needs. According to Gartner inquiries, flexible data schemas and application development velocity are cited as primary factors influencing adoption. Secondary factors attracting enterprises are global replication capabilities, high performance and developer interest.*

However, while NoSQL technologies address some document database needs, we’ve been hearing feedback that customers want a way to bridge document database functionality with the transactional capabilities of relational databases. Azure DocumentDB is our answer to that feedback – it’s a NoSQL document database-as-a-service that provides the benefits of a NoSQL document database but also adds the query processing and transaction semantics common to relational database systems.

Built for the cloud, Azure DocumentDB natively supports JSON documents enabling easy object mapping and iteration of data models for application development. Azure DocumentDB offers programming libraries for several popular languages and platforms, including.Net, Node.js, JavaScript, and Python. We will be contributing the client libraries to the open source community, so they can incorporate improvements into the versions published on Azure.com.

One DocumentDB customer, Additive Labs, builds online services to help their customers move to the cloud. "DocumentDB is the NoSQL database I am expecting today,” said Additive Labs Founder Thomas Weiss. “The ease and power of SQL-like queries had me started in a matter of minutes. And the ability to augment the engine’s behavior with custom JavaScript makes it way easier to adapt to our customers’ new requirements.”

Preview of Azure Search

Search has become a natural way for users to interact with applications that manage volumes of data.  However, managing search infrastructure at scale can be difficult and time consuming and often requires specialized skills and knowledge. Azure Search is a fully-managed search-as-a-service that customers can use to integrate complete search experiences into applications and connect search results to business objectives through fine-tuned, ranking profiles. Customers do not have to worry about the complexities of full-text search or deploying, maintaining or managing a search infrastructure.

With Azure Search developers can easily provision a search service, quickly create and tune one or more indexes, upload data to be indexed and start issuing searches. The service offers a simple API that’s usable from any platform or development environment and makes it easy to integrate search into new or existing applications. With Azure Search, developers can use the Azure portal or management APIs to increase or decrease capacity in terms of queries per second and document count as load changes, delivering a more cost effective solution for search scenarios. 

Retail platform provider Xomni is already using Azure Search to help the company manage its cloud infrastructure. "We have the most technically advanced SaaS solution for delivering product catalogue data to the retail industry in the market today,” said Xomni CTO Daron Yondem. “Integrating Azure Search into our platform will help solidify our leadership as datasets and faceted search requirements evolve over time."

General availability of Apache HBase for HDInsight

In partnership with Hortonworks, we’ve invested in the Hadoop ecosystem through contributions across projects like Tez, Stinger and Hive. Azure HDInsight, our Hadoop-based service, is another outcome of that partnership.

Azure HDInsight combines the best of Hadoop open source technology with the elasticity and manageability that enterprises require. Today, we’re making generally available HBase as a managed cluster inside HDInsight. HBase clusters are configured to store data directly in Azure Blob storage. For example, customers can use HDInsight to analyze large datasets in Azure Blobs generated from highly-interactive websites or can use it to analyze sensor and telemetry data from millions of end points.

Microsoft data services

Azure data services provide unparalleled choice for businesses, data scientists, developers and IT pros with a variety of managed services from Microsoft and our partners that work together seamlessly and connect to our customers’ data platform investments-- from relational data to non-relational data, structured data to unstructured data, constant and evolving data models. I encourage you to try out our new and expanded Azure data services and let us know what you think.

*Gartner, Hype Cycle for Information Infrastructure, 2014, Mark Beyer and Roxane Edjlali, 06 August 2014

 

###

Categories: Database

Importance of Recovery Model in SQL Server

Database Journal News - Thu, 08/21/2014 - 08:01

Have you ever wondered, especially in the case of a data warehousing scenario, why the transaction log file grows bigger and bigger--sometimes much bigger than your database's data files? What caused it to happen? How do you control it? How does the recovery model of a database control the growing size of the transaction log? Read on to learn the answers.

Categories: Database

Reduce the source footprint of CDC by querying databases for archive logs

IBM - DB2 and Informix Articles - Thu, 08/21/2014 - 05:00
Learn how the Change Data Capture (CDC) Oracle Redo physical standby configuration in InfoSphere Data Replication allows CDC to read logs off the standby device regardless of the log shipment method. This configuration reduces the source footprint by querying the standby database for archive log information.
Categories: Database

Barman 1.3.3 released

PostgreSQL News - Thu, 08/21/2014 - 01:00

21 August 2014: 2ndQuadrant is proud to announce the release of version 1.3.3 of Barman, Backup and Recovery Manager for PostgreSQL.

This major release improves robustness of both backup procedures and their monitoring, by introducing:

  • the so-called "smelly backup" control, allowing DBAs to detect possible problems in scheduling of periodical backups, by receiving complaints by "barman check" when the latest available backup for a server is older than a specified timeframe
  • management of retry attempts for base backup copy (for both "barman backup" and "barman recover" commands), making the operation more resilient to temporary issues such as network connection drops

Performance issues have been fixed in relation to remote recovery over existing directories (incremental recovery), by invoking checksum control only when strictly necessary.

Usability has been enhanced through better exception handling, output and logging messages. PostgreSQL 8.3 is also now supported.

The following major bugs have been fixed:

  • Copies "recovery.conf" during remote "barman recover" (#43)
  • Correctly detect pre/post archive hook scripts (#41)

Minor bugs have also been fixed.

Many thanks for funding towards the development of this release go to Agile Business Group (www.agilebg.com), Jobrapido (www.jobrapido.com), Navionics (www.navionics.com), and Subito.it (www.subito.it).

For a complete list of changes, see the "Release Notes" section below.

Links

Release notes

  • Added "last_backup_max_age", a new global/server option that allows administrators to set the max age of the last backup in a catalogue, making it easier to detect any issues with periodical backup execution
  • Improved robustness of "barman backup" by introducing two global/server options: "basebackup_retry_times" and "basebackup_retry_sleep". These options allow an administrator to specify, respectively, the number of attempts for a copy operation after a failure, and the number of seconds of wait before retrying
  • Improved the recovery process via rsync on an existing directory (incremental recovery), by splitting the previous rsync call into several ones - invoking checksum control only when necessary
  • Added support for PostgreSQL 8.3
  • Minor changes:
    • Support for comma separated list values configuration options
    • Improved backup durability by calling fsync() on backup and WAL files during "barman backup" and "barman cron"
    • Improved Nagios output for "barman check --nagios"
    • Display compression ratio for WALs in "barman show-backup"
    • Correctly handled keyboard interruption (CTRL-C) while performing barman backup
    • Improved error messages of failures regarding the stop of a backup
    • Wider coverage of unit tests
  • Bug fixes:
    • Copies "recovery.conf" on the remote server during "barman recover" (#43)
    • Correctly detect pre/post archive hook scripts (#41)

Download

About Barman

Barman (Backup and Recovery Manager) is an open source administration tool for disaster recovery of PostgreSQL servers written in Python. It allows your organisation to perform remote backups of multiple servers in business critical environments and help DBAs during the recovery phase. Barman’s most requested features include backup catalogues, retention policies, remote backup and recovery, archiving and compression of WAL files and backups. Barman is distributed under GNU GPL 3.

Categories: Database, Open Source

Build a data mining app using Java, Weka, and the Analytics Warehouse service

IBM - DB2 and Informix Articles - Wed, 08/20/2014 - 05:00
The Analytics Warehouse (formerly BLU Acceleration) service provides data warehousing and analytics as a service on IBM Bluemix. Developers can develop and deploy a heavy-duty analytic application using blazing-fast IBM BLU database technology offered in the cloud. Learn how to develop a data mining application using the Weka statistical analysis tool and leveraging the IBM BLU columnar database.
Categories: Database

Build a cache application in the cloud with Bluemix cache services

IBM - DB2 and Informix Articles - Tue, 08/19/2014 - 05:00
This tutorial talks about building caching applications on top of the IBM Cloud environment. The execution time recorded demonstrates the speed of accessing the caching service.
Categories: Database

Introducing POWA ! A new PostgreSQL Workload Analyzer

PostgreSQL News - Tue, 08/19/2014 - 01:00

DALIBO is proud to present the first release of POWA, a brand new performance tool for PostgreSQL.

Realtime traffic analysis and dynamic graphs

POWA is a workload analyzer that gives a clear view of the current activity of your PostgreSQL servers with a query runtime graph and a block hit/read graph along with a chart of time consuming request over the specified time period.

If you zoom anywhere in one of the graphs, the chart will adjust and show you which queries were running at that time. If you click on a specific query, you will get additional graphs such as read/write time, number of rows affected, local and shared hit, etc.

A bunch of PL functions are also available to access and manage the stats.

Extending pg_stat_statements

Basically PoWA is a PostgreSQL extension designed to historize information given by the pg_stat_statements extension. It provides SQL SRF to gather useful information on a specified time interval.

This first release is ready for production but of course we will continue to improve it. Please install it (or test our demo site) and let's us know what you think of it. Right now what we need most is feedback and new ideas, especially to improve the user experience and the graphic interface...

PoWA is available under the PostgreSQL license. The main code is a PostgreSQL extension written in C and SQL. The user interface is based on Perl and Mojolicious. Obviously the stats are stored in a PostgreSQL database :-)

For the complete list of changes, please checkout the release note on https://github.com/dalibo/powa/blob/master/CHANGELOG.md

Credits

DALIBO would like to thank all the developers who contributed to this release, especially : Marc Cousin for the original idea and Julien Rouhaud for the hard work on the GUI.

POWA is an open project available under the PostgreSQL License. Any contribution to build a better tool is welcome. You just have to send your ideas, features requests or patches using the GitHub tools or directly to powa@dalibo.com

Links :

About POWA :

PoWA is PostgreSQL Workload Analyzer that gathers performance stats and provides real-time charts and graph to help monitor and tune your PostgreSQL servers. It is similar to Oracle AWR or SQL Server MDW.

Code & Demo at http://dalibo.github.io/powa/

About DALIBO :

DALIBO is the leading PostgreSQL company in France, providing support, trainings and consulting to its customers since 2005. The company contributes to the PostgreSQL community in various ways, including : code, articles, translations, free conferences and workshops

Check out DALIBO's open source projects at http://dalibo.github.io

http://www.dalibo.com

Categories: Database, Open Source

Big Data Technologists Transition to Customer-Facing Roles

Database Journal News - Mon, 08/18/2014 - 08:01

Big data applications do not need the same infrastructure support teams as do more common applications. As the enterprise embraces big data, management assumes that staff sizes will decrease. What should be done with those unneeded technologists? One answer: convert them into technology consultants that collaborate and coordinate with the lines of business. In other words, give them customer-facing roles.

Categories: Database

DBD::Pg 3.4.0 released

PostgreSQL News - Mon, 08/18/2014 - 01:00

Version 3.4.0 of DBD::Pg, the Perl driver for Postgres, has been released: http://search.cpan.org/dist/DBD-Pg/

This version greatly enhanced the table_info() and column_info() methods.

Categories: Database, Open Source

Oracle: Getting The Starting Date Of A Week Using Week Number

Database Journal News - Thu, 08/14/2014 - 08:01

Week numbering schemes are interesting and getting the starting date based on that number is even more so. Read on to see what schemes there are and if you can, indeed, get the starting date you expect.

Categories: Database

Generate reports remotely and offline with InfoSphere Optim Performance Manager command-line utility

IBM - DB2 and Informix Articles - Thu, 08/14/2014 - 05:00
You can use predefined report features in the InfoSphere Optim Performance Manager for DB2 for Linux, UNIX and Windows web console to generate reports in HTML, PDF, PPT, and XLS formats. In this tutorial, learn how to extend these features with the command-line utility (CLU). With the CLU, you can generate reports in offline and batch mode without logging on to the web console, schedule reports to run at periodic intervals, and send reports as attachments to team members.
Categories: Database

Remove and reintegrate an auxiliary standby in an HADR setup

IBM - DB2 and Informix Articles - Wed, 08/13/2014 - 05:00
Starting with IBM DB2 10.1, the High Availability Disaster Recovery (HADR) feature supports multiple standbys. With multiple standbys, you can have your data in more than two sites for improved data protection with a single technology. This article provides detailed steps for removing and reintegrating the auxiliary standby in a multiple standby HADR setup.
Categories: Database