Subscribe to Blog via Email
Follow me on TwitterMy Tweets
I love technology- ALL TECHNOLOGY. This includes loving my Mac Air and loving my Microsoft Surface Pro 4. I’ve recently went back to a Mac when I joined Delphix, trimming down the power I had on my Surface Pro 4, knowing the content I was providing would be required to run on hardware with lesser resources.
With the release of Microsoft SQL Server 2016 on Linux, I jumped in with both feet and wanted to install it on one of my Linux VMs that I have “discovered” with my Delphix engine and its Oracle environment. To accomplish this, the OS version was CentOS, which wasn’t a supported OS, but did work with the yum commands with a few changes and with an upgrade from CentOS 6.6 to 7.
After upgrading and installing SQL Server 2016, I became aware that the memory requirements, once trimmed down on the VM to less than 1.5Gb, now required at least 3.5G to run. My Mac Air has only 8G of memory on it and to run a Delphix environment, you have the stand alone Delphix engine, (a simple software appliance) VM, a “Source” environment and a “Target” environment. To run three environments with that much of an increase in resource demands for the source and target was a bit too much for the little machine.
Moving a VM from a Mac to a PC is easy by copying the .ova file and importing it on the new PC. Upon doing so, I noted that it was from the original version and didn’t include my OS upgrade or the MSSQL installation.
I was able to quickly see this by comparing the images with the following command:
I took a new snapshot, brought the new file over and imported again, but no change occurred. I then decided to do some testing of how robust and how dependent VMs are.
Ensuring the VM was DOWN, I copied the actual VM’s folder on my Mac Air to a jump drive. It was almost 18 GB.
I then switched over to the Surface and with the VM down, renamed the original folder and copied the one from my MAC into the same directory. I then renamed it to be the same as the original, (I had to remove the .vmwarevm extension on the folder) which then mimicked the original it was replacing. Here’s the folder with the .vmwarevm extension on the jumpdrive-
And here’s how I renamed the original folder to “old” and then copied the Mac version to the same directory and removed the extension. Notice that the name now matches what it would have been for the original, which will also match what is in the Windows registry:
I restarted the VM and then checked that everything came up and verify that the image contained the correct OS and MSSQL installation:
Ahhh, much better…. 🙂 Now my upgraded VM with the addition of MSSQL 2016 has some room to move and grow!
A number of emails I received about trying out Delphix Express was regarding VMWare. Many of my followers had used Virtualbox for a long time and we all know, no one likes change, (OK, maybe me, but we know how abnormal I am anyway… :))
Importing an OVA is pretty simple in VMWare. In the VMWare Fusion application, click on File, Import and accept the defaults. Depending on the size of the VM, the process will take the time needed to import and if anything happens to the VM you imported in, the great thing about a VM, you just have to DELETE AND IMPORT AGAIN to erase that which you have destroyed. 🙂
Open the VM Control Console, click on the VM you want to delete, then click on Remove. Remember to click on delete files if you’d like that space back on your hard drive, too! The utility will take just a moment to clean up the VM and you can then proceed with work or re-import in the OVA file.
I know, if using Delphix Express, the IP address for the machine is displayed when it’s first started, but I also know that we DBAs are a curious lot and known for snooping around every chance we get. Due to this, you may not have noted the IP address and now need it to log into a terminal windows or want a second terminal to run or check items.
Knowing how to return the IP address is a good thing to know, so here are all the ways depending on what OS you’re on:
Linux- type in ifconfig from the terminal and you’ll see the IP address listed for the inet address for the eth0 configuration, (commonly setup as the eth0.)
Windows- ipconfig -a from the Command prompt or Click on the Window Icon, type in “Network” to go to Network and Ethernet and then click on ethernet. Your IP Address is listed in in the IPv4 Address setting.
Mac- ifconfig from terminal of click on the Apple up at top left corner of screen, click on System Preferences, click on Network, then if you’re using WiFi, click on it and then TCP/IP to view your actual IP Address listed for the IPv4 address.
If the VMware screen is blank, (no test or image on the screen or you’ve lost your cursor, the best way to get control back is to click Ctrl/Command on Mac to retrieve cursor control or make return your screen to active.
Every software has updates and just like the other software we support, updates to VMware is important. We may not utilize our VMs as often as we think, so it’s good to get into the practice to check for updates when you first log into VMware by clicking on VMWare Fusion and Check for Updates. If only takes a moment and hopefully you’ll see the following after it’s gone out to check:
By that, I mean to remember that you’re on one PC and you’re running virtual PCs on it. Don’t take up so many resources to your VMs that your PC doesn’t have enough to do its job. A VM should be pretty conservative on its resources and its important to look at the configuration and see if you can dial down any usage that isn’t necessary.
To do this, the VM must be shutdown, (not just suspended) and click on Virtual Machine, Settings. In your settings, there are a couple areas that need to be considered for resource usage:
The first, obviously, is to look at Processors & Memory. Ensure you’ve left enough memory for your PC and as PCs come with quad-core or higher processors these days, a single core is often sufficient for the processing on a VM.
The amount of space that is being used by a VM is a consideration, too. If a VM is so large that you need to purchase an external drive to run it on, then that’s a better choice vs. using up all your local disk or it may be time to build out Delphix just to virtualize the environment to start! 🙂
Verify that all disks for the VM are actually in use. I’ve seen where their are drives created for future growth, but never used or extra space that was allocated that just needs to be shrunk down. This can be accomplished by clicking on Virtual Machine, Settings and then from there, click on each of the disks in use by the VM, shrinking any that may have been over-allocated to. This is another task that can only be performed when the VM is shutdown.
Well, there’s a start to getting comfortable with VMWare Fusion. Do you have any tips or tricks that you can add to this? Comment and let use know and have a great Monday!
Delphix Express offers a virtual environment to work with all the cool features like data virtualization and data masking on just a workstation or even a laptop. The product has an immense offering, so no matter how hard Kyle, Adam and the other folks worked on this labor of love, there’s bound to be some manual configurations that are required to ensure you get the most from the product. This is where I thought I’d help and offer a virtual hug to go along with the virtual images…:)
If you’re already set on installing and working<– (Link here!!) with Delphix Express, you will find the following Vimeo videos- importing the VMs and configuring Delphix Express quite helpful. Adam Bowen did a great job with these videos to get you started, but below, I’ll go through some technical details a bit deeper to give folks added arsenal in case they’ve missed a step or challenged just starting out with VMWare.
Note- Delphix Express requires VMWare Fusion, which you can download after purchasing a license, ($79.99) but well worth the investment.
Not enough memory to run all three VM’s required as part of Delphix Express or after an upgrade, the Delphix Express uses over 6Gb.
Different laptops/workstations have different amounts of memory, CPU and space available. Memory is the most common constraint with today’s pc. Although the VMs are configured for optimal performance, the target and source environments can have the memory trimmed to 2Gb each and still perform when resources are constrained.
The VM must be shut down for this configuration change to be implemented. After stopping or before starting the VM, click on Virtual Machine, Settings. Click on Processors and Memory and then you can configure the memory usage via a slider option as seen below:
Move the slider to under 2G for the VM in question and then close the configuration window and start the VM. Perform this for each VM, (the Delphix Engine VM should already be at 2Gb.)
Issue- Population of sources and targets is empty after successful configuration.
After starting the target and source VMs, a UI interface with command line is opened and you can login right from the VMWare. Virtualbox would require a terminal opened to the desktop, but either way, you can get to the command line interface in such a way without using Putty or another desktop terminal from your workstation.
On the target VM command line, login as the delphix user. The target VM has a python script that runs in the background upon startup that checks for a delphix engine once every minute and if it locates one, will run the configuration. You can view this running in the cron:
crontab -l @reboot ..... /home/delphix/landshark_setup.py
It writes to the following log file:
You can view this file, (or tail it or cat it, whatever you are comfortable doing to view the end of the file…) I prefer just to view the last ten lines, so I’ll run a command to look at JUST the last ten lines:
tail -10 landshark_setup.log
If the configuration is having issues locating the Delphix engine, it will show in this log file. Once confirmed, then we have a couple steps to check:
VMWare issue with the one of the virtual machines not visible to another. Each VM needs to be able to communicate and interact with each other. When importing in each VM, the ability for the VM to be “host aware” with the Mac may not have occurred. If you the delphix engine VM isn’t viewable to the target or the source, you can check the log and then verify in the following way.
Click on Virtual Machine, Settings and then click on Network Adapter. Verify that the top radio option is selected for “Share with my Mac”:
Verify that this is configured for EACH of the three virtual machines involved. If this hasn’t corrected and the configuration doesn’t populate the virtual environments in the Delphix interface, then it’s time to look at the configuration for the target machine.
Get IP Address
While SSH connected to the target machine, type in the following:
Use the IP address shown, (inet address) and open a browser on your PC, adding the port used for the target configuration file, (port 8000 by default):
You should be shown the configuration file for your target server that is used to run the delphix engine configuration. There are options to update the values for different parameters. The you should focus on are:
linux_source_ip= make sure this matches the source VM’s ip address when you type in “ifconfig”.
engine_address= ip address for the delphix engine VM when you type in ifconfig on the host
engine_password= should match the password that you updated your delphix_admin to when you went through the configuration. Update it to match if it doesn’t, as I’ve seen some folks not set it to “landshark” as demonstrated in the videos, so of course, the setup will fail when the file doesn’t match the password set by the user.
oracle_xe = If you set Oracle_xe to true, then don’t set the 11g or 12c to true. To conserver workstation resources, choose only one database type.
Once you’re made all the changes you want to the page, click on Submit Changes.
You need to run the reconfiguration manually now. Remember, this runs in the background each minute, but when it does that, you can’t see what’s going on, so I recommend killing the running process and running it manually.
From the target host, type in the following:
ps -ef | grep landshark_setup
Kill the running processes:
Check for any running processes, just to be safe:
ps -ef | grep landshark_setup
Once you’ve confirmed that none are running, let’s run the script manually from the delphix user home:
Verify that the configuration runs, monitoring as it steps through each step:
This is the first time you’re performed these steps, so expect a refresh won’t be performed, but a creation will. You should now see the left panel of your Delphix Engine UI populated:
Now we’ve come to the completion of the initial configuration. In my next post on Delphix Express, I’ll discuss the Dsource and Target database configurations for different target types. Working with these files and configurations are great practice to learning about Delphix, even if your Delphix Express even if you are amazed at how easy this all was.