Happy Thanksgiving!, great to have a relaxing Thursday morning on the couch, doing nothing but watching last night's NHL highlights while tinkering with some new programming technologies, drinking a cup of strong coffee.
This past summer I spent some time trying to develop some sample game code (blog post: fixed-frequency-uncoupled-game-loop) in C, using libSDL on the Linux platform. I made some progress, but it was difficult, fairly low level, and I kind of lost motivation when work picked up for me this fall.
Recently I downloaded and installed the MS Visual Studio 2010 Express with XNA Game Studio 4.0 to give Windows/XBOX/Windows Phone game programming a shot to hopefully make faster progress. I have done C# before with my adventures in the WorldWind .NET project. Here is my result of my efforts this morning, a moving rectangle sprite:
It was fairly revealing that the easy to follow first tutorial for XNA Windows game development was creating a sprite that moves around a game window, just like my bouncy rectangle game. It took me about half an hour to build the tutorial, what took several days in C with libSDL. The basic project takes care of the game loop for it and it seems to be an uncoupled model between the game logic and drawing of graphics. The game played at a constant speed plus my CPU was only around 7% utilized.
I guess the tradeoff is being locked into Microsoft products, with little hope of ever porting to other platforms. But given I am my own developer, it makes sense to use this platform to actually get some programs made. I like how all the tools are basically free and well integrated together.
Thursday, November 24, 2011
XNA .NET Bouncy Rectangle Tutorial
Labels:
.NET,
C#,
gaming,
Visual Studio .NET,
Windows
Saturday, October 1, 2011
Redwoods summer update
Its been a while since I wrote about our redwood seedlings. They have been growing indoors for a little over a year now. These pictures were actually taken a few months ago when tropical storm Irene came through New England. After a fairly quiet and slow winter, these guys both started major growth spurts in the late springtime and continued to grow new needles, shoots and branches. J2 especially gained a few inches growing a new shoot straight up nearly 6 inches from where the crown used to be. B2 has seen more modest growth, but was spreading out more along the branches near the base.
Right now, J2 is getting to be about 1.5 feet tall, while B2 has not straightened out yet, and has stayed around a foot in height.
The trunk on both is getting stiffer and covered in a brownish-red bark, the needles used to feel softer to the touch. Overall both plants feel dry to the touch and a bit prickly due to the needles.
I generally water once or twice a week, and spray with water now and then in addition to keep the branches and needles moist.
Summer is about over now up here, so I would guess we won't see much growth, and even some browning of needles, over the winter.
![]() |
| J2 growing well by the window |
![]() |
| B2 is a bit crooked |
The trunk on both is getting stiffer and covered in a brownish-red bark, the needles used to feel softer to the touch. Overall both plants feel dry to the touch and a bit prickly due to the needles.
I generally water once or twice a week, and spray with water now and then in addition to keep the branches and needles moist.
Summer is about over now up here, so I would guess we won't see much growth, and even some browning of needles, over the winter.
![]() |
| J2 closeup |
Labels:
arboriculture,
redwood
Saturday, September 24, 2011
PunchClock 0.2.3 Released
After putting PunchClock on hold to work on C coding this past summer. I've resumed work and completed a few features for PunchClock. Mainly these greatly help me in my own job, they probably could be useful for others.
Download PunchClock 0.2.3
Tour of whats new in PunchClock 0.2.3
I skipped a formal release of 0.2.2 as there wasn't much new for the end user, that release mainly dealt with bug fixing and refactoring for JFace.
I am getting close to finishing what I wanted to achieve now with PunchClock, It will now be something that will be an accelerator at my own job and I will try to share it with my team. There are a few things in the UI that I would like to tighten up. For example the layout changes a little too much when the main window is resized. I could add a few more options to the Export wizard. I currently don't have support .xlsx format output. Maybe when I get around to these last few areas I would be comfortable with a version 1.0 release.
Please let me know if you have any feedback or comments.
Download PunchClock 0.2.3
Tour of whats new in PunchClock 0.2.3
- Added new feature: Stats widget in UI
- Tracks how long you are spending on the current task.
- Keeps a running total of all tasks for that calendar day: "have I billed 8 hours to my client today?"
- Brand new Export feature
- File > Export launches a new wizard to export a file to Excel
- Selectable Date Range
- Excel 97-2003 format (.xls), compatible with OpenOffice, GoogleDocs
- Exported Excel provides automatic summations of tasks for each day by project. Color coded by day for easier review.
- Uses Apache POI library.
- Fixed a bug on exit that wouldn't properly save the end time for a current session.
- Behind the scenes all the UI has now been reimplemented using JFace
- Fixed a few other dings and scratches.
I skipped a formal release of 0.2.2 as there wasn't much new for the end user, that release mainly dealt with bug fixing and refactoring for JFace.
I am getting close to finishing what I wanted to achieve now with PunchClock, It will now be something that will be an accelerator at my own job and I will try to share it with my team. There are a few things in the UI that I would like to tighten up. For example the layout changes a little too much when the main window is resized. I could add a few more options to the Export wizard. I currently don't have support .xlsx format output. Maybe when I get around to these last few areas I would be comfortable with a version 1.0 release.
Please let me know if you have any feedback or comments.
Labels:
java,
punchclock,
SWT,
Time Track
Saturday, August 27, 2011
Fixed Frequency Uncoupled Game Loop
Version 2 of the Bouncy Rectangle program has a refactored game loop engine. After looking around at ways to separate the rate that events happen in the game from the rendering speed of the system running the program I went with an approach called Fixed-Frequency Uncoupled method. Where the game engine will run certain events at fixed frequency, while uncoupling a second module of the program that does the rendering using as much CPU speed is available. To make it interesting I also added an AI opponent, which is another blue square that follows the player around the screen. (No music this time).
To implement multi-threading I used POSIX threads (-pthreads). The fixed frequency game logic would update the game state based on user input and the physics of the moving rectangle "characters". It would then sleep for 100 ms, basically updating the game state 10 times a second.
The render loop was in the main thread and would both update the screen with the updated game state as well as do some animation interpolation based on the trajectories of the rectangles from the last game state. This also had to trap any user input (keyboard keys) and then update the game state with these inputs for when the fixed-frequency thread would next check it. To avoid synchronization issues, I used mutexes when in critical sections that accessed the shared variables containing game state info. The render loop will run as fast as the system it runs on, on my box it was humming along at 140 fps.
This is a high level diagram of the separation of the game logic:
References:
To implement multi-threading I used POSIX threads (-pthreads). The fixed frequency game logic would update the game state based on user input and the physics of the moving rectangle "characters". It would then sleep for 100 ms, basically updating the game state 10 times a second.
The render loop was in the main thread and would both update the screen with the updated game state as well as do some animation interpolation based on the trajectories of the rectangles from the last game state. This also had to trap any user input (keyboard keys) and then update the game state with these inputs for when the fixed-frequency thread would next check it. To avoid synchronization issues, I used mutexes when in critical sections that accessed the shared variables containing game state info. The render loop will run as fast as the system it runs on, on my box it was humming along at 140 fps.
This is a high level diagram of the separation of the game logic:
References:
- Sleeping a Posix Thread: pthread_cond_timedwait()--Timed Wait for a Condition
- Valente, L., Conci, A., and Feijó, B. 2005. Real time game loop models for single-player computer games. In Proceedings of the IV Brazilian Symposium on Computer Games and Digital Entertainment, 89--99. Downloaded from: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.118.8892
Sunday, August 14, 2011
libSDL Project
For the last few weekends I have given PunchClock and my java work a break, to get back to the fun stuff in C. I am trying to learn the open source Simple DirectMedia Layer (libSDL) api for 2d graphics.
My first simple project was to draw a background and move an object around the foreground. Enter "Bouncy Rectangle".
This is a very simple program where you control the movements of the red square by using the keyboard arrows. Pressing in a direction will either speed you up or slow you down, when you hit one of the edges your speed will be translated into the opposite direction so you "bounce" like a pool ball.
I'd like to work further on separating the movement speeds from the "game loop" which will use 100% of whatever CPU you have if you let it, which would vary the speed from system to system.
The source code is all in one file, after installing libSDL (not so simple on Ubuntu) the program was developed in Eclipse CDT.
Full Source for reference:
The build command I used was:
And the linking command was:
References
Helpful sites that allowed me to get this far
My first simple project was to draw a background and move an object around the foreground. Enter "Bouncy Rectangle".
This is a very simple program where you control the movements of the red square by using the keyboard arrows. Pressing in a direction will either speed you up or slow you down, when you hit one of the edges your speed will be translated into the opposite direction so you "bounce" like a pool ball.
I'd like to work further on separating the movement speeds from the "game loop" which will use 100% of whatever CPU you have if you let it, which would vary the speed from system to system.
The source code is all in one file, after installing libSDL (not so simple on Ubuntu) the program was developed in Eclipse CDT.
Full Source for reference:
/*
============================================================================
Name : BouncyRectangle.c
Author : ammianus
Version : 0.0.1
Copyright : Copyright Brian Laskey 2011
Description : Bouncy rectangle SDL example
Developed in Eclipse CDT, using SDL 1.3.0
============================================================================
*/
#include <stdio.h>
#include <sdl sdl.h="">
/* game loop states */
#define GAME_LOOP_RUNNING 1
#define GAME_LOOP_STOP 0
/* movement constant */
#define MAX_VELOCITY 20
#define VELOCITY_INCREMENT 10
/* pointer to the main window surface */
SDL_Surface *screen;
/*
* Draw the graphic to the coordinates specified on to the screen.
*
* (0,0) is the top left corner of the visible screen.
*
* \param graphic the pointer to a surface containing graphic
* to draw on screen
* \param x the x-coordinate on the screen surface
* of the top-left corner of the graphic to draw
* \param y the y-coordinate on the screen surface of the top-left corner
* of the graphic to draw
*/
void drawGraphic(SDL_Surface *graphic, const int x, const int y) {
/*initialize SDL_Rect struct to hold destination blitting data*/
SDL_Rect dst;
/*fill dst with relevant information*/
dst.x = x;
dst.y = y;
dst.w = graphic->w;
dst.h = graphic->h;
/*blit the graphic to the screen*/
SDL_BlitSurface(graphic, NULL, screen, &dst);
}
/*
* Check if the velocity plus the increment is under max velocity
*/
Uint8 checkVelocity(int velocity) {
Uint8 underMax;
if (velocity + VELOCITY_INCREMENT <= MAX_VELOCITY) {
underMax = 1;
} else {
underMax = 0;
}
return underMax;
}
/*
* Check if the velocity minus the increment is under absolute max velocity
*/
Uint8 checkNegativeVelocity(int velocity) {
Uint8 underMax;
if (abs(velocity - VELOCITY_INCREMENT) <= MAX_VELOCITY) {
underMax = 1;
} else {
underMax = 0;
}
return underMax;
}
/*
* Process the SDL Event queue
*
* \param running pointer to running flag for game loop (passed by reference)
* \param velocity_y pointer to velocity_y incremented
* or decremented by up or down (passed by reference)
* \param velocity_x pointer to velocity_x incremented
* or decremented by left or right (passed by reference)
*/
void processEvents(int *running, int *velocity_y, int *velocity_x) {
/*e stores the event union which is fetched from the event queue*/
SDL_Event e;
/*check the event queue*/
while (SDL_PollEvent(&e)) {
switch (e.type) {
case SDL_KEYDOWN:
if (e.key.keysym.sym == SDLK_ESCAPE) {
*running = GAME_LOOP_STOP;
} else if (e.key.keysym.sym == SDLK_DOWN) {
/* increase or decrease current velocity */
if (checkVelocity(*velocity_y))
*velocity_y = *velocity_y + 10;
} else if (e.key.keysym.sym == SDLK_UP) {
if (checkNegativeVelocity(*velocity_y))
*velocity_y = *velocity_y - 10;
} else if (e.key.keysym.sym == SDLK_LEFT) {
if (checkNegativeVelocity(*velocity_x))
*velocity_x = *velocity_x - 10;
} else if (e.key.keysym.sym == SDLK_RIGHT) {
if (checkVelocity(*velocity_x))
*velocity_x = *velocity_x + 10;
}
break;
case SDL_QUIT:
*running = GAME_LOOP_STOP;
break;
}
}
fprintf(stdout, "velocity_x: %d, velocity_y: %d\n", *velocity_x,
*velocity_y);
}
/* Call this instead of exit(), so we can clean up SDL: atexit() is evil. */
static void quit(int rc) {
SDL_Quit();
exit(rc);
}
/*
* main: no arguments
*
* \return:
* 0 success
* 1 could not init SDL
* 2 could not create the screen surface
* 3 graphics error
*/
int main(void) {
Uint8 video_bpp;
Uint32 videoflags;
int x_offset;
int y_offset;
int video_w, video_h;
int velocity_x, velocity_y;
/*declare pointer to reference the graphic
* (done here for plain C compatibility)*/
SDL_Surface *background_graphic;
SDL_Surface *bouncy_rectangle;
int running;
int fillRectRet;
/* Initialize SDL */
if (SDL_Init(SDL_INIT_VIDEO) < 0) {
fprintf(stderr, "Couldn't initialize SDL: %s\n", SDL_GetError());
return (EXIT_FAILURE);
}
video_bpp = 0;
videoflags = SDL_HWSURFACE | SDL_DOUBLEBUF;
video_w = 640;
video_h = 480;
puts("!!!SDL_INIT!!!");
screen = NULL;
/*set a 640x480x32 double-buffered window*/
if ((screen = SDL_SetVideoMode(video_w, video_h, video_bpp, videoflags))
== NULL) {
fprintf(stderr, "Couldn't set %dx%d %d video mode: %s\n", video_w,
video_h, video_bpp, SDL_GetError());
quit(2);
}
/*Example: set up a fullscreen double-buffered hardware display
* surface at 640x480x32*/
/*SDL_Surface *screen =
* SDL_SetVideoMode(640,480,32,SDL_HWSURFACE|SDL_FULLSCREEN|SDL_DOUBLEBUF);*/
/*load the background graphic from a file*/
background_graphic = NULL;
background_graphic = SDL_LoadBMP("background1.bmp");
if (background_graphic != NULL) {
puts("!!!SDL_LoadBMP!!!");
} else {
fprintf(stderr, "my_graphic is NULL: %s\n", SDL_GetError());
quit(3);
}
/* create moving red rectangle on the surface */
bouncy_rectangle = NULL;
bouncy_rectangle = SDL_CreateRGBSurface(0, 50, 50, 32, 0, 0, 0, 0);
if (bouncy_rectangle != NULL) {
fillRectRet = SDL_FillRect(bouncy_rectangle, NULL, SDL_MapRGB(
screen->format, 255, 0, 0));
if (fillRectRet == 0) {
puts("Filled bouncy_rectangle");
} else {
fprintf(stderr, "SDL_FillRect error: %s\n", SDL_GetError());
}
} else {
fprintf(stderr, "bouncy_rectangle is NULL: %s\n", SDL_GetError());
quit(3);
}
/* initial values */
running = GAME_LOOP_RUNNING;
x_offset = 0;
y_offset = 0;
velocity_x = 0;
velocity_y = 0;
while (running) {
/*clear the screen*/
fillRectRet = SDL_FillRect(screen, NULL, SDL_MapRGB(screen->format, 0,
0, 0));
if (fillRectRet == 0) {
puts("!!!Screen Cleared!!!");
} else {
fprintf(stderr, "SDL_FillRect error: %s\n", SDL_GetError());
}
/* calculate the boundary of bouncy_rectangle against edges of screen */
/* x-axis */
if ((x_offset + 50 + velocity_x > video_w) || (x_offset + velocity_x
< 0)) {
velocity_x = velocity_x * -1;
}
x_offset = (x_offset + velocity_x);
/* y-axis */
if ((y_offset + 50 + velocity_y > video_h) || (y_offset + velocity_y
< 0)) {
velocity_y = velocity_y * -1;
}
y_offset = (y_offset + velocity_y);
/*draw the background*/
drawGraphic(background_graphic, 0, 0);
fprintf(stdout, "x %d, y %d\n", x_offset, y_offset);
/* move the rectangle across the screen */
drawGraphic(bouncy_rectangle, x_offset, y_offset);
puts("!!!Draw!!!");
/*update the screen*/
SDL_Flip(screen);
puts("!!!Flip!!!");
/*check the event queue*/
processEvents(&running, &velocity_y, &velocity_x);
/* pause the program so CPU doesn't go to 100% */
SDL_Delay(40);
}
/*deinitialize SDL*/
SDL_Quit();
puts("!!!SDL_Quit!!!");
return EXIT_SUCCESS;
}The build command I used was:
gcc -O0 -g3 -pedantic -Wall -c -fmessage-length=0 -MMD -MP -MF"src/BouncyRectangle.d" -MT"src/BouncyRectangle.d" -o"src/BouncyRectangle.o" "../src/BouncyRectangle.c"
And the linking command was:
gcc -L/usr/local/lib -o"SB-Proto1" ./src/BouncyRectangle.o -lSDLmain -lSDL
References
Helpful sites that allowed me to get this far
- To install SDL on Linux manually
- SDL dev on Eclipse set up
- Environment set up for running outside of Eclipse:
- Problem I faced before I could get any simple program to work: SDL_INIT: returns error "Couldn't initialize SDL: No available video device"
- (Needed to compile with X11 Dev library: sudo apt-get install xorg-dev)
Friday, July 22, 2011
On Configuring Automated Builds on an Amazon EC2 micro-instance using Jenkins, SVN and Apache
I am a big fan of the continuous integration approach with using tools and build scripts to automate the build process for programs. Combine this with comprehensive unit testing and static analysis provides some easy ways to improve the quality of code.
So I wanted to implement a continuous integration set up, partly as a way to improve my infrastructure around the PunchClock project, as well as a chance to explore some new technologies, especially Amazon Web Services.
What I settled on was to create a "build machine" using Jenkins CI, formerly Hudson, an open source program specifically for automating building software in a continuous integration environment. On the same server I would also host my Subversion repository (SVN), and being that it is an Amazon EC2 instance I have less worry of a possibility of a catastrophic loss of data from my current Ubuntu box at home. Both SVN and the Jenkins web application would sit behind an Apache2 Web Server. All of this would be on a Debian Linux distro running as an EC2 instance. (I chose to go with Debian purely to gain exposure to other distros besides Ubuntu). I learned a lot from this set up, the AWS/EC2 was actually more challenging than you would normally find from a hosted server, but their AWS Management Console allows you to do most operations pretty easily.
Prereqs
Installation
All of these steps I honed on a default Debian install. I tested this on VMWare Player running the 6.0.1a "Squeeze" Debian install, from an iso file found on BitTorrent. Once I had got the steps down, basically the same applied to installing on the Debian instance on Amazon EC2 except for a few issues. All of these steps were performed as root unless otherwise noted.
Amazon EC2 Configuration
This is a whole other technology, which deserves its own post. I'll touch on what I did find in the end. I was motivated to look into this, Amazon AWS recently began offering the ability to have a single "micro" sized instance hosted for free. This gets you among other things, a virtual machine with 620 MB of memory, a single "virtual cpu", about up to 10GB EBS storage space, the OS of your choice* and a certain monthly bandwidth. I haven't been on the service a month yet, so we'll see how I get billed.
*The idea with these instances is that they are virtual machines that you can start from a pre-packaged snapshot referred to as an AMI. Amazon provides some (of their own linux flavor) but most appear to be community created public images for different OS's. I found a lot of information around this whole topic, as well as really well done, standardized AMI's from http://alestic.com/, which focuses mostly on Ubuntu images. The EC2StartersGuide for Ubuntu is also a great starting resource, especially for managing and configuring your EC2 instances from a Ubuntu desktop. In my case with Debian, the ec2debian google group was also a good place to start.
Long story short, when you sign up for AWS and log in to the Management Console, go to "Instances" and click on Launch Instance, you can search for an select a starting AMI. I went wit this one from the ec2debian group
us-east-1
i386 EBS: ami-0ce41865
x86_64 EBS: ami-80e915e9
i386 8gb instance: ami-c041bda9
x86_64 8gb instance: ami-1cbc4375
The distinction between instance and EBS is that instance root volume apparently doesn't survive a stoppage of the VM, not sure the benefit of that other than to keep things clean? I went with the x86_64 EBS: ami-80e915e9 after a false start with the 32 bit version.
Note these all start out with a 1GB Root volume. Needs to be reized.
After booting up, and figuring out how to connect to the instance (only can use ssh, scp...be prepared to use vi!).
Some issues I hit:
Java 6 won't install on 32-bit "micro" instance
Originally I tried a 32 bit debian instance AMI. Hit this bug everytime I installed sun-java6-jdk: https://bugs.launchpad.net/ubuntu/+source/linux-ec2/+bug/634487 which basically caused the whole instance to hang due to 100% CPU usage from a runaway install process. The only fix was to use a 64-bit AMI.
Enlarging EBS Root Volume
After finally installing everything and pressing the final key-stroke to start Jenkins, I was severly disappointed to only get a 503: Service Unavailable error from Apache. The Jenkins log wasn't created even and the Apache logs just stated that it couldn't connect to the Jenkins site. After banging my head against the wall, I found a not enough disk space error in the /var/logs/daemon log. It turned out I maxed the 1GB initial volume size. Unfortunately EBS volumes can't just be "dialed up" like you can do with a VMWare Player VM. Some guidance can be found here on how to resize a root EBS volume: http://alestic.com/2010/02/ec2-resize-running-ebs-root
Basically what I ended up doing using the AWS Management Console
So I wanted to implement a continuous integration set up, partly as a way to improve my infrastructure around the PunchClock project, as well as a chance to explore some new technologies, especially Amazon Web Services.
What I settled on was to create a "build machine" using Jenkins CI, formerly Hudson, an open source program specifically for automating building software in a continuous integration environment. On the same server I would also host my Subversion repository (SVN), and being that it is an Amazon EC2 instance I have less worry of a possibility of a catastrophic loss of data from my current Ubuntu box at home. Both SVN and the Jenkins web application would sit behind an Apache2 Web Server. All of this would be on a Debian Linux distro running as an EC2 instance. (I chose to go with Debian purely to gain exposure to other distros besides Ubuntu). I learned a lot from this set up, the AWS/EC2 was actually more challenging than you would normally find from a hosted server, but their AWS Management Console allows you to do most operations pretty easily.
Prereqs
- Install Apache2 if not present
On the default Debian install Apache is present, but on the Debian EC2 AMI I used it wasn't installed.
apt-get install apache2
- Install Java 1.6 (update 25)
You'll need to edit your /etc/apt/sources.list see http://jayraj87.blogspot.com/2010/02/installing-sun-java6-jdk-in-debian.html
- Install Ant 1.8.0
- installs version 1.8.0 to /usr/bin/ant (/usr/share/ant)
apt-get install ant
- copy junit.jar to ANT_HOME\lib (junit 3.8.2 or later download here)
- installs version 1.8.0 to /usr/bin/ant (/usr/share/ant)
- Install SVN and Repository
- I installed SVN and then moved my existing repository to a location (this is a good article on moving svn: http://linux.justinhartman.com/Moving_a_Subversion_repository_to_another_server) .
- Also configured Apache2 with dav_svn for webaccess and basic authentication (http://davidwinter.me/articles/2006/02/16/subversion-over-apache-2-on-ubuntu/)
- Before you begin I assume you have your own working ANT script that would compile, run JUnit tests, run any static analysis utilities (e.g. FindBugs or CheckStyle) and package your project into artifacts for distribution. The PunchClock application had an existing ANT build.xml that I started from.
Installation
All of these steps I honed on a default Debian install. I tested this on VMWare Player running the 6.0.1a "Squeeze" Debian install, from an iso file found on BitTorrent. Once I had got the steps down, basically the same applied to installing on the Debian instance on Amazon EC2 except for a few issues. All of these steps were performed as root unless otherwise noted.
- Install Jenkins LTS
wget -q -O - http://pkg.jenkins-ci.org/debian/jenkins-ci.org.key | sudo apt-key add -
- Add site to debian packages /etc/apt/sources.list: deb http://pkg.jenkins-ci.org/debian binary/
apt-get update
apt-get install jenkins
- Installs at http://localhost:8080/ by default
- Followed steps to configure Jenkins to run behind Apache https://wiki.jenkins-ci.org/display/JENKINS/Running+Jenkins+behind+Apache
- configuration is in /etc/default/jenkins
- I changed default port from 8080 for added security
- add HTTP_HOST=127.0.0.1 #only takes requests from apache2
- append to JENKINS_ARGS="... --prefix=/jenkins httpListenAddress=$HTTP_HOST"
- To restart after config changes:
/etc/init.d/jenkins force-reload - Log file will be placed in /var/log/jenkins/jenkins.log. Check this file if you are troubleshooting Jenkins.
- Setting up apache for Jenkins
Apache will be a reverse proxy to the Jenkins web application. We've already set up Jenkins to only accept requests from Apache (localhost), we will also add basic authentication. See also (https://wiki.jenkins-ci.org/display/JENKINS/Installing+Jenkins+on+Ubuntu)
- Create or copy this file called "jenkins" to /etc/apache2/sites-available
<VirtualHost *:80>
ServerAdmin your.email@yourorganization.com
ServerName your.ip.here.goes.here
ServerAlias debian-build
ProxyRequests Off
<Proxy *>
Order deny,allow
Allow from all
</Proxy>
ProxyPreserveHost on
ProxyPass /jenkins http://localhost:8089/jenkins
ProxyPassReverse /jenkins http://localhost:8089/jenkins
<Location /jenkins/>
AuthType basic
AuthName "Jenkins"
AuthUserFile "/etc/apache2/sites-available/jenkins.htpasswd"
Require valid-user
</Location>
- Run the following commands to set up Apache for virtual hosts and create the site "/jenkins"
a2enmod proxy
a2enmod proxy_http
a2enmod vhost_alias
a2ensite jenkins
apache2ctl restart
- Note: apache logs under /var/log/apache/error.log
- I am no apache security configuration expert, but following this article was useful for configuring basic authentication for now. https://wiki.jenkins-ci.org/display/JENKINS/Apache+frontend+for+security
- E.g in my case it was something like this:
htpasswd -cm /etc/apache2/sites-available/jenkins.htpasswd your-username - In my opinion security is often overlooked in small scale projects, other general, but useful Apache security tips: http://httpd.apache.org/docs/2.0/misc/security_tips.html
- After all of this you should be able to access Jenkins with the specified username/password at a URL like
http://your.ip.here.goes.here/jenkins
- Create or copy this file called "jenkins" to /etc/apache2/sites-available
- Install checkstyle
For CheckStyle analysis of Java code (assuming you've already configured your project and build.xml to run CheckStyle during the build) - Download checkstyle-5.3-bin.tar.gz (at the time of this post 5.4 is available)
- Copy to somewhere on the server e.g. /usr/share
- Extract the tar
$/usr/share# tar zxf check checkstyle-5.3-bin.tar.gz - Log in to Jenkins and navigate to Manage Jenkins > Configure System
- Check "Environment Variables" under Global Properties
- Add name = "CHECKSTYLE_HOME" value = "/usr/share/checkstyle-5.3"
- Install findbugs
Similarly for FindBugs analysis of Java code. (* I couldn't actually get this to successfully run on the EC2 Micro instance, it appeared to make the server run out of memory and the Jenkins build process would crash.) - Download findbugs-1.3.9.tar.gz
- Copy to somewhere on the server e.g. /usr/share
- Extract the tar
$/usr/share# tar zxf check findbugs-1.3.9.tar.gz - Log in to Jenkins and navigate to Manage Jenkins > Configure System
- For "Environment Variables" under Global Properties
- Add name = "FINDBUGS_HOME" value = "/usr/share/findbugs-1.3.9"
- Copy the findbugs_ant.jar to ANT_HOME/lib
$/usr/share/findbugs-1.3.9/lib# cp findbugs-ant.jar /usr/share/ant/lib- Manage Jenkins plugins for Static Analysis
- Log in to and navigate to Jenkins > Manage > Available >
- Check the following plugins
- Static Analysis Utilities
- Checkstyle Plug-in
- FindBugs Plug-in
- etc...
- Jenkins may need to be restarted manually using /etc/init.d/jenkins force-reload
- Configure Jenkins project: PunchClock
- Log in to Jenkins and click New Jobs from the left menu. Fill out the following form. The details will vary per your project and needs.
- Job Name: PunchClock
- Set repostitory to Subversion
- URL: http://ip.of.my.svn.repo/svn/trunk/TimeTrack
- Will fail, need to enter credentials
- Add Build Step > Invoke Ant
- Check publishing options
- Publish Checkstyle analysis results
- Publish FindBugs analysis results
- Publish combined analysis results
- Publish JUnit test result report
- My Test Result XMLs use the pattern "TEST*.xml"
- Archive the artifacts
- This depends on what artifacts your build.xml creates, my PunchClock complete packages are zipped in the distributions folder of my work space so: Files to archive: "distributions/*.*"
- Optional you can set an automated checkout strategy. Under Build Triggers I chose "Poll SCM"
- For schedule I used "@hourly"
Amazon EC2 Configuration
This is a whole other technology, which deserves its own post. I'll touch on what I did find in the end. I was motivated to look into this, Amazon AWS recently began offering the ability to have a single "micro" sized instance hosted for free. This gets you among other things, a virtual machine with 620 MB of memory, a single "virtual cpu", about up to 10GB EBS storage space, the OS of your choice* and a certain monthly bandwidth. I haven't been on the service a month yet, so we'll see how I get billed.
*The idea with these instances is that they are virtual machines that you can start from a pre-packaged snapshot referred to as an AMI. Amazon provides some (of their own linux flavor) but most appear to be community created public images for different OS's. I found a lot of information around this whole topic, as well as really well done, standardized AMI's from http://alestic.com/, which focuses mostly on Ubuntu images. The EC2StartersGuide for Ubuntu is also a great starting resource, especially for managing and configuring your EC2 instances from a Ubuntu desktop. In my case with Debian, the ec2debian google group was also a good place to start.
Long story short, when you sign up for AWS and log in to the Management Console, go to "Instances" and click on Launch Instance, you can search for an select a starting AMI. I went wit this one from the ec2debian group
us-east-1
i386 EBS: ami-0ce41865
x86_64 EBS: ami-80e915e9
i386 8gb instance: ami-c041bda9
x86_64 8gb instance: ami-1cbc4375
The distinction between instance and EBS is that instance root volume apparently doesn't survive a stoppage of the VM, not sure the benefit of that other than to keep things clean? I went with the x86_64 EBS: ami-80e915e9 after a false start with the 32 bit version.
Note these all start out with a 1GB Root volume. Needs to be reized.
After booting up, and figuring out how to connect to the instance (only can use ssh, scp...be prepared to use vi!).
Some issues I hit:
Java 6 won't install on 32-bit "micro" instance
Originally I tried a 32 bit debian instance AMI. Hit this bug everytime I installed sun-java6-jdk: https://bugs.launchpad.net/ubuntu/+source/linux-ec2/+bug/634487 which basically caused the whole instance to hang due to 100% CPU usage from a runaway install process. The only fix was to use a 64-bit AMI.
Enlarging EBS Root Volume
After finally installing everything and pressing the final key-stroke to start Jenkins, I was severly disappointed to only get a 503: Service Unavailable error from Apache. The Jenkins log wasn't created even and the Apache logs just stated that it couldn't connect to the Jenkins site. After banging my head against the wall, I found a not enough disk space error in the /var/logs/daemon log. It turned out I maxed the 1GB initial volume size. Unfortunately EBS volumes can't just be "dialed up" like you can do with a VMWare Player VM. Some guidance can be found here on how to resize a root EBS volume: http://alestic.com/2010/02/ec2-resize-running-ebs-root
Basically what I ended up doing using the AWS Management Console
- Create EBS snapshot
- Stop Instance
- Detach old volume
- create new volume from snapshot
- Attach new volume (as /dev/sda1...same as old volume!)
- Start Instance
- resize2fs /dev/xvda1 (Debian is tricky that it doesn't list the volume as /dev/sda1). It did an online resize in about 5 minutes and I was good to go.
Labels:
java,
Linux,
punchclock,
svn
Sunday, June 19, 2011
Converting SWT to JFace
It has been a slow couple of weeks for my coding. I've had a lot of activities going on which have kept me away. Today I focused on making a major architectural change to PunchClock by reimplementing the view layer of PunchClock to completely use the JFace pattern instead of the pure SWT that was mostly there.
To do this I had to rewrite all of my custom SWT dialog shell code using various subclasses of the JFace Dialog class. All of my menu bar was replaced using a set of JFace MenuManagers with related Actions. Finally the main application Shell was implemented through a new class that extends ApplicationWindow and acts as the "central glue" for the new JFace implementation. As always the tutorials by Adrian Emmenis, "Using the Eclipse GUI outside the Eclipse Workbench", were my main guide in this process although was also able to use the SWT/JFace javadocs available in the Eclipse Platform API Specification reference site.
The purported benefits of using JFace is that it "is a UI toolkit that provides helper classes for developing UI features that can be tedious to implement". So one would hope that this could be quantified in terms of fewer lines of code, easier readability and/or maintainability. As PunchClock 0.2.1 is a fairly stable, simple application, using a couple of JFace dialogs, but not depending on it too much, I was hoping to see evidence of a benefit by switching over. To be honest, the experience today felt like rearranging deck chairs on a cruise ship. Generally what I needed to do was move methods around from a class that previously managed most of the SWT UI interactions and updates and put these chunks of code into other more object oriented classes, such as Dialogs, ApplicationWindow or Actions. A lot of my EventListeners, for menu items for example were easily converted to JFace Actions with a couple of constructor changes and converting the implementation of SelectionListener.widgetSelected() method to override the Action.run() method. For example:
Before old SWT code with Listener for the "Open" menu item
Now becomes just:
Now, a lot of the code above is actually still there, just contained in the new object OpenProjectDialog which extends JFace's Dialog class. The one big benefit I notice with Dialogs is that you get the OK and Cancel buttons "for free". So instead of needing to build the popup window from scratch as shown above, I just overrode and implemented the createDialogArea() and okPressed() methods from Dialog with my custom functions. That completely removes maintaining the Cancel button code from my responsibility for example.
Whether the conversion to JFace has objectively produced less code for the same exact results, I utilized a free code line counter, CLOC, to check how much improvements there were at all.
Before (v0.2.1 code pulled from SVN)
JFace ApplicationWindow's mysterious separator line
One quirk that I did come across after the conversion to pure JFace implemenation of the main window, was that it seems the default behavior for ApplicationWindow is to create a separator line at the top of the window's "contents" panel. This is in case you have a menu. This wasn't there before the port, so I was pretty confused. I began coloring all the widgets in my UI to try to understand what was creating this line but had no luck, because it wasn't in my code after all. See the strange extra line on the left.
In my ApplicationWindow class, it turns out you need to override the ApplicationWindow#showTopSeperator() method and make sure it returns false if you don't need it, and this depends on which OS you have e.g. for Windows 7 and Mac OSX the menu bar is separate from the application panel anyways, no separator is needed. It may mean that for some OSs like Win XP for example, I might need to make the code smarter to conditionally show the separator or not.
To do this I had to rewrite all of my custom SWT dialog shell code using various subclasses of the JFace Dialog class. All of my menu bar was replaced using a set of JFace MenuManagers with related Actions. Finally the main application Shell was implemented through a new class that extends ApplicationWindow and acts as the "central glue" for the new JFace implementation. As always the tutorials by Adrian Emmenis, "Using the Eclipse GUI outside the Eclipse Workbench", were my main guide in this process although was also able to use the SWT/JFace javadocs available in the Eclipse Platform API Specification reference site.
The purported benefits of using JFace is that it "is a UI toolkit that provides helper classes for developing UI features that can be tedious to implement". So one would hope that this could be quantified in terms of fewer lines of code, easier readability and/or maintainability. As PunchClock 0.2.1 is a fairly stable, simple application, using a couple of JFace dialogs, but not depending on it too much, I was hoping to see evidence of a benefit by switching over. To be honest, the experience today felt like rearranging deck chairs on a cruise ship. Generally what I needed to do was move methods around from a class that previously managed most of the SWT UI interactions and updates and put these chunks of code into other more object oriented classes, such as Dialogs, ApplicationWindow or Actions. A lot of my EventListeners, for menu items for example were easily converted to JFace Actions with a couple of constructor changes and converting the implementation of SelectionListener.widgetSelected() method to override the Action.run() method. For example:
Before old SWT code with Listener for the "Open" menu item
/**
* @param shell
*/
public OpenAction(Shell shell, TimeTrackController controller, DialogSettings settings) {
_shell = shell;
_controller = controller;
_settings = settings;
}
/*
* (non-Javadoc)
*
* @see org.eclipse.swt.events.SelectionAdapter#widgetSelected
* (org.eclipse.swt.events.SelectionEvent)
*/
public void widgetSelected(SelectionEvent e) {
// create new dialog where user enters the project name
final Shell dialog = new Shell(_shell, SWT.DIALOG_TRIM
| SWT.APPLICATION_MODAL);
dialog.setText("Open Project");
FormLayout formLayout = new FormLayout();
formLayout.marginWidth = 10;
formLayout.marginHeight = 10;
formLayout.spacing = 10;
dialog.setLayout(formLayout);
// position near parent window location
dialog.setLocation(_shell.getLocation().x + 10,
_shell.getLocation().y + 10);
// text displayed in dialog
Label openProjectLabel = new Label(dialog, SWT.NONE);
openProjectLabel.setText("Type a Project name:");
FormData data = new FormData();
openProjectLabel.setLayoutData(data);
//for combo box
String[] options = new String[]{};
try{
List availableProjects = _controller.getProjects();
options = new String[availableProjects.size()];
availableProjects.toArray(options);
}catch(IOException ioe){
ioe.printStackTrace();
}
//creates cancel button
Button cancel = new Button(dialog, SWT.PUSH);
cancel.setText("Cancel");
data = new FormData();
data.width = 60;
data.right = new FormAttachment(100, 0);
data.bottom = new FormAttachment(100, 0);
cancel.setLayoutData(data);
cancel.addSelectionListener(new SelectionAdapter() {
public void widgetSelected(SelectionEvent e) {
System.out.println("User cancelled dialog");
dialog.close();
}
});
//creates text box
//final Text textBox = new Text(dialog, SWT.BORDER);
data = new FormData();
data.width = 200;
data.left = new FormAttachment(openProjectLabel, 0, SWT.DEFAULT);
data.right = new FormAttachment(100, 0);
data.top = new FormAttachment(openProjectLabel, 0, SWT.CENTER);
data.bottom = new FormAttachment(cancel, 0, SWT.DEFAULT);
//textBox.setLayoutData(data);
//textBox.forceFocus();
final Combo combo = new Combo(dialog, SWT.NONE);
combo.setItems (options);
//set the default text to the first option, can be overridden by user
if(options.length > 0){
String selectedOption = Configuration.getSetting(_settings, Configuration.LAST_PROJECT, options[0]);
combo.setText(selectedOption);
}
combo.setLayoutData(data);
combo.forceFocus();
//creates ok button
Button ok = new Button(dialog, SWT.PUSH);
ok.setText("OK");
data = new FormData();
data.width = 60;
data.right = new FormAttachment(cancel, 0, SWT.DEFAULT);
data.bottom = new FormAttachment(100, 0);
ok.setLayoutData(data);
ok.addSelectionListener(
// nested inner class
new SelectionAdapter() {
/*
* (non-Javadoc)
*
* @see org.eclipse.swt.events.SelectionAdapter
* #widgetSelected (org.eclipse.swt.events.SelectionEvent)
*/
public void widgetSelected(SelectionEvent e) {
String selectedProject = combo.getText();
//set the project in the controller
_controller.setProject(selectedProject);
//updated the last project setting with chosen value
_settings.put(Configuration.LAST_PROJECT, selectedProject);
// close the message dialog
dialog.close();
}
});
dialog.setDefaultButton(ok);
dialog.pack();
dialog.open();
}
Now becomes just:
/**
* @param shell
*/
public OpenAction(PunchClockWindow window) {
_window = window;
setText("&Open Project...\tCTRL+O");
ImageRegistry reg = Resources.getImageRegistry();
setImageDescriptor(reg.getDescriptor(Resources.IMAGES_FOLDER_OPEN_PNG));
}
/* (non-Javadoc)
* @see org.eclipse.jface.action.Action#run()
*/
public void run() {
// create new JFace dialog where user enters the project name
OpenProjectDialog projDialog = new OpenProjectDialog(_window);
projDialog.open();
}
Now, a lot of the code above is actually still there, just contained in the new object OpenProjectDialog which extends JFace's Dialog class. The one big benefit I notice with Dialogs is that you get the OK and Cancel buttons "for free". So instead of needing to build the popup window from scratch as shown above, I just overrode and implemented the createDialogArea() and okPressed() methods from Dialog with my custom functions. That completely removes maintaining the Cancel button code from my responsibility for example.
Whether the conversion to JFace has objectively produced less code for the same exact results, I utilized a free code line counter, CLOC, to check how much improvements there were at all.
Before (v0.2.1 code pulled from SVN)
http://cloc.sourceforge.net v 1.53 T=0.5 s (64.0 files/s, 10350.0 lines/s)After JFace conversion of view layer
-------------------------------------------------------------------------------
Language files blank comment code
-------------------------------------------------------------------------------
Java 32 725 1680 2770
-------------------------------------------------------------------------------
SUM: 32 725 1680 2770
-------------------------------------------------------------------------------
http://cloc.sourceforge.net v 1.53 T=0.5 s (66.0 files/s, 9538.0 lines/s)There was an 8% shrinking of the code. Not too bad, I'll take it.
-------------------------------------------------------------------------------
Language files blank comment code
-------------------------------------------------------------------------------
Java 33 705 1510 2554
-------------------------------------------------------------------------------
SUM: 33 705 1510 2554
-------------------------------------------------------------------------------
JFace ApplicationWindow's mysterious separator line
One quirk that I did come across after the conversion to pure JFace implemenation of the main window, was that it seems the default behavior for ApplicationWindow is to create a separator line at the top of the window's "contents" panel. This is in case you have a menu. This wasn't there before the port, so I was pretty confused. I began coloring all the widgets in my UI to try to understand what was creating this line but had no luck, because it wasn't in my code after all. See the strange extra line on the left.
![]() |
| JFace application window adds this extra line, shown on the left. |
In my ApplicationWindow class, it turns out you need to override the ApplicationWindow#showTopSeperator() method and make sure it returns false if you don't need it, and this depends on which OS you have e.g. for Windows 7 and Mac OSX the menu bar is separate from the application panel anyways, no separator is needed. It may mean that for some OSs like Win XP for example, I might need to make the code smarter to conditionally show the separator or not.
Labels:
java,
punchclock,
SWT,
Time Track
Subscribe to:
Posts (Atom)







